Aug 04 12:13:15 devstack cinder-volume[77841]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 04 12:13:15 devstack cinder-volume[77841]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 04 12:13:15 devstack cinder-volume[77841]: we strongly recommend against using it for new projects. Aug 04 12:13:15 devstack cinder-volume[77841]: If you are already using Eventlet, we recommend migrating to a different Aug 04 12:13:15 devstack cinder-volume[77841]: framework. For more detail see Aug 04 12:13:15 devstack cinder-volume[77841]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 04 12:13:15 devstack cinder-volume[77841]: import eventlet # noqa Aug 04 12:13:19 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:13:19 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:13:19 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:13:20 devstack cinder-volume[77841]: INFO dbcounter [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Registered counter for database cinder Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG oslo_db.sqlalchemy.engines [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG dbcounter [-] [77841] Writer thread running {{(pid=77841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:13:20 devstack cinder-volume[77841]: INFO cinder.rpc [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 04 12:13:20 devstack cinder-volume[77841]: INFO cinder.rpc [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG oslo_db.sqlalchemy.engines [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:13:20 devstack cinder-volume[77841]: INFO cinder.volume.manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Determined volume DB was empty at startup. Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG cinder.volume.manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77841) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 04 12:13:20 devstack cinder-volume[77841]: INFO cinder.volume.manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 04 12:13:20 devstack cinder-volume[77841]: WARNING stevedore.named [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 04 12:13:20 devstack cinder-volume[77841]: WARNING castellan.key_manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:13:20 devstack cinder-volume[77841]: WARNING cinder.keymgr.conf_key_mgr [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG cinder.volume.drivers.lvm [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77841) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 04 12:13:20 devstack cinder-volume[77841]: DEBUG oslo_concurrency.processutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_concurrency.processutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] CMD "cinder-rtstool verify" returned: 0 in 0.522s {{(pid=77841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_db.sqlalchemy.engines [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:13:21 devstack cinder-volume[77841]: INFO cinder.rpc [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 04 12:13:21 devstack cinder-volume[77841]: INFO cinder.rpc [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 04 12:13:21 devstack cinder-volume[77841]: WARNING stevedore.named [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 04 12:13:21 devstack cinder-volume[77841]: WARNING castellan.key_manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:13:21 devstack cinder-volume[77841]: INFO cinder.volume.manager [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_db.sqlalchemy.engines [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:13:21 devstack cinder-volume[77841]: INFO oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Starting 1 workers Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Started child 78125 {{(pid=77841) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Full set of CONF: {{(pid=77841) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] ******************************************************************************** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Configuration options gathered from: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] ================================================================================ {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] allow_availability_zone_fallback = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] allow_compression_on_image_upload = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] allowed_direct_url_schemes = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] api_rate_limit = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] auth_strategy = keystone {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[78125]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] az_cache_duration = 3600 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_availability_zone = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_host = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_stats_polling_interval = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backup_api_class = cinder.backup.api.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backup_name_template = backup-%s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backup_use_same_host = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backup_use_temp_snapshot = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] chap_password = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] chap_username = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_internal_tenant_project_id = 13cc7a0997c64455a7e4c70ae1194509 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_internal_tenant_user_id = 9949b5801eab4613b8d3cb6e3801b462 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cloned_volume_same_az = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cluster = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] compression_format = gzip {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] compute_api_class = cinder.compute.nova.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] config_dir = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] config_source = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] control_exchange = openstack {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] debug = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] default_availability_zone = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] default_group_type = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] default_volume_type = lvmdriver-1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] disk_geometry = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_client_cert = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_client_cert_key = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_data_namespace = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_ssl_cert_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_ssl_cert_verify = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] driver_use_ssl = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] enable_force_upload = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] enable_new_services = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] enable_unsupported_driver = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] enabled_backends = ['lvmdriver-1'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] enforce_multipath_for_image_xfer = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] filter_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_api_insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_api_ssl_compression = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_ca_certificates_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_catalog_info = image:glance:publicURL {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_num_retries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance_request_timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] goodness_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] graceful_shutdown_timeout = 5 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] group_api_class = cinder.group.api.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] host = devstack {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_compress_on_upload = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_conversion_address_space_limit = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_conversion_cpu_limit = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_conversion_disable = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_upload_use_cinder_backend = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_upload_use_internal_tenant = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_volume_cache_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_volume_cache_max_count = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] image_volume_cache_max_size_gb = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] init_host_max_objects_retrieval = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] instance_format = [instance: %(uuid)s] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iscsi_target_flags = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iscsi_write_cache = on {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iser_helper = tgtadm {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iser_ip_address = 192.168.122.136 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iser_port = 3260 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_color = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_config_append = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_dir = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_options = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_rotate_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_rotate_interval_type = days {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] log_rotation_type = none {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] max_age = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] max_logfile_count = 30 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] max_logfile_size_mb = 200 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] max_over_subscription_ratio = 20.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] message_reap_interval = 86400 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] message_ttl = 2592000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] migration_create_volume_timeout_secs = 300 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] monkey_patch = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] monkey_patch_modules = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] my_ip = 192.168.122.136 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] no_snapshot_gb_quota = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] num_iser_scan_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] num_shell_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] num_volume_device_scan_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] nvmeof_conn_info_version = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] nvmet_ns_id = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] nvmet_port_id = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_max_limit = 1000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_ext_list = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_listen = 0.0.0.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_listen_port = 8776 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_use_ssl = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] osapi_volume_workers = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] per_volume_size_limit = -1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] periodic_fuzzy_delay = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] periodic_interval = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] project_id_regex = [0-9a-f\-]+ {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] public_endpoint = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] publish_errors = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_backup_gigabytes = 1000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_backups = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_gigabytes = 1000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_groups = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_snapshots = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] quota_volumes = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] rate_limit_burst = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] rate_limit_except_level = CRITICAL {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] rate_limit_interval = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] reinit_driver_count = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] replication_device = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] report_discard_supported = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] report_interval = 120 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] reservation_clean_interval = 86400 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] reservation_expire = 86400 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] reserved_image_namespaces = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] reserved_percentage = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] rpc_response_timeout = 120 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] run_external_periodic_tasks = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] scst_target_driver = iscsi {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] scst_target_iqn_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_down_time = 720 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] shell_completion = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] snapshot_name_template = snapshot-%s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] snapshot_same_host = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] split_loggers = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] state_path = /opt/stack/data/cinder {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] storage_availability_zone = nova {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] storage_protocol = iSCSI {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] syslog_log_facility = LOG_USER {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_helper = lioadm {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_ip_address = 192.168.122.136 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_port = 3260 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_protocol = iscsi {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[78125]: INFO cinder.volume.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] target_secondary_ip_addresses = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] trace_flags = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] transfer_api_class = cinder.transfer.api.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] transport_url = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] until_refresh = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_chap_auth = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_default_quota_class = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_journal = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_json = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_multipath_for_image_xfer = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_stderr = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] use_syslog = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] verify_glance_signatures = enabled {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_api_class = cinder.volume.api.API {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_backend_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_clear = zero {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_clear_ionice = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_clear_size = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_copy_bps_limit = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_dd_blocksize = 1M {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_name_template = volume-%s {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_service_inithost_offload = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volume_usage_audit_period = month {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] zoning_mode = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_concurrency.disable_process_locking = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.auth_section = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.auth_type = password {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.auth_version = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.cache = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.delay_auth_decision = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.http_connect_timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.include_service_catalog = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.interface = public {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_password = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcache_username = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.region_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.service_token_roles_required = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.service_type = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.token_cache_time = 300 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.backend = dogpile.cache.null {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.backend_argument = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.backend_expiration_time = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.config_prefix = cache.oslo {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.debug_cache_backend = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.enable_retry_client = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.enable_socket_keepalive = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.expiration_time = 600 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.hashclient_retry_attempts = 2 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_dead_retry = 300 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_pool_maxsize = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_sasl_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.password = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.proxies = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.redis_db = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.redis_sentinel_service_name = mymaster {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.redis_server = localhost:6379 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.retry_attempts = 2 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.retry_delay = 0.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.socket_keepalive_count = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.socket_keepalive_idle = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.socket_keepalive_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.socket_timeout = 1.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.tls_allowed_ciphers = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.tls_cafile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.tls_certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.tls_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.tls_keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cache.username = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] coordination.backend_url = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.asyncio_connection = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.asyncio_slave_connection = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.backend = sqlalchemy {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.connection = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.connection_debug = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.connection_parameters = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.connection_recycle_time = 3600 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.connection_trace = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.db_inc_retry_interval = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.db_max_retries = 20 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.db_max_retry_interval = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.db_retry_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.max_overflow = 50 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.max_pool_size = 5 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.max_retries = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.mysql_wsrep_sync_wait = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.pool_timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.retry_interval = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.slave_connection = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.sqlite_synchronous = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.synchronous_reader = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] database.use_db_reconnect = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.connection_string = messaging:// {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.es_doc_type = notification {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.es_scroll_size = 10000 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.es_scroll_time = 2m {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.filter_error_trace = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.hmac_keys = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.sentinel_service_name = mymaster {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.socket_timeout = 0.1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.trace_requests = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler.trace_sqlalchemy = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:21 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler_jaeger.process_tags = {} {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler_jaeger.service_name_prefix = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] profiler_otlp.service_name_prefix = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.enforce_new_defaults = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.policy_default_rule = default {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.policy_file = policy.yaml {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_policy.remote_timeout = 60.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.group = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.helper_command = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] privsep_osbrick.user = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.group = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.helper_command = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] cinder_sys_admin.user = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.auth_section = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.auth_type = password {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.cafile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.collect_timing = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.send_service_user_token = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.split_loggers = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] service_user.timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.auth_section = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.auth_type = password {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.collect_timing = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.region_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.split_loggers = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] glance.timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.backend_availability_zone = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.chap_password = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.chap_username = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.disk_geometry = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_client_cert = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_client_cert_key = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_data_namespace = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.driver_use_ssl = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.enable_unsupported_driver = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.extra_capabilities = {} {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.filter_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.goodness_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iscsi_target_flags = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iscsi_write_cache = on {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iser_helper = tgtadm {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iser_port = 3260 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.lvm_mirrors = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.lvm_share_target = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.lvm_type = auto {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.num_shell_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.nvmet_port_id = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.replication_device = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.report_discard_supported = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.reserved_percentage = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.scst_target_driver = iscsi {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.scst_target_iqn_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.storage_protocol = iSCSI {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_helper = tgtadm {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_port = 3260 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_protocol = iscsi {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.trace_flags = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.unique_fqdn_network = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.use_chap_auth = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_backend_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_clear = zero {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_clear_ionice = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_clear_size = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volume_group = cinder-volumes {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_reports.file_event_handler = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_reports.log_dir = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.backend_availability_zone = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack sudo[78190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.backend_host = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.chap_password = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.chap_username = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.chiscsi_conf = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.disk_geometry = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_client_cert = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_data_namespace = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.driver_use_ssl = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.extra_capabilities = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.filter_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.goodness_function = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack sudo[78190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iser_helper = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iser_ip_address = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iser_port = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.iser_target_prefix = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.lvm_conf_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.lvm_mirrors = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.lvm_share_target = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.lvm_type = auto {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.num_shell_tries = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.nvmet_port_id = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.replication_device = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.report_discard_supported = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.reserved_percentage = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.scst_target_driver = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.storage_protocol = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_helper = lioadm {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_ip_address = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_port = 3260 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_protocol = iscsi {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.trace_flags = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.use_chap_auth = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_clear = zero {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_clear_size = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] lvmdriver-1.volumes_dir = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.ssl_version = {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_notifications.driver = [] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_notifications.retry = -1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] oslo_messaging_notifications.transport_url = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] key_manager.fixed_key = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.barbican_api_version = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.barbican_endpoint = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.barbican_endpoint_type = public {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.barbican_region_name = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.cafile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.collect_timing = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.number_of_retries = 60 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.retry_delay = 1 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.send_service_user_token = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.split_loggers = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.verify_ssl = True {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican.verify_ssl_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.auth_section = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.auth_type = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.cafile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.certfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.collect_timing = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.insecure = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.keyfile = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.split_loggers = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] barbican_service_user.timeout = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.approle_role_id = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.approle_secret_id = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.auth_method = approle {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.auth_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.kv_mountpoint = secret {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.kv_path = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.kv_version = 2 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.namespace = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.root_token_id = **** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.ssl_ca_crt_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.timeout = 60.0 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.token_file = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.token_role = None {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.use_ssl = False {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:13:21 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] ******************************************************************************** {{(pid=77841) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 04 12:13:22 devstack sudo[78190]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:22 devstack sudo[78286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:22 devstack sudo[78286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:22 devstack sudo[78286]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:13:22 devstack cinder-volume[78125]: INFO cinder.brick.local_dev.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:22 devstack sudo[78372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:22 devstack sudo[78372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:22 devstack sudo[78372]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG cinder.brick.local_dev.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78125) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 04 12:13:22 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:22 devstack sudo[78476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:22 devstack sudo[78476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:23 devstack sudo[78476]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.039s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:23 devstack sudo[78726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:23 devstack sudo[78726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:23 devstack sudo[78726]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:23 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:24 devstack sudo[78730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 04 12:13:24 devstack sudo[78730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:24 devstack sudo[78730]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.318s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:24 devstack sudo[78805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:24 devstack sudo[78805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:24 devstack sudo[78805]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:24 devstack sudo[78822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:24 devstack sudo[78822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:24 devstack sudo[78822]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:24 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:24 devstack sudo[78825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:25 devstack sudo[78825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:25 devstack sudo[78825]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:25 devstack sudo[78834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:25 devstack sudo[78834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:25 devstack sudo[78834]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:25 devstack sudo[78838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:25 devstack sudo[78838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:25 devstack sudo[78838]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:25 devstack cinder-volume[78125]: INFO cinder.volume.drivers.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:25 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:25 devstack sudo[78842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:25 devstack sudo[78842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:26 devstack sudo[78842]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:26 devstack sudo[78845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:26 devstack sudo[78845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:26 devstack sudo[78845]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:26 devstack sudo[78848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:26 devstack sudo[78848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:26 devstack sudo[78848]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:26 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:26 devstack sudo[78853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:26 devstack sudo[78853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:27 devstack sudo[78853]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:27 devstack sudo[78857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:27 devstack sudo[78857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:27 devstack sudo[78857]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:27 devstack cinder-volume[78125]: INFO cinder.volume.driver [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Driver hasn't implemented _init_vendor_properties() Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG cinder.volume.driver [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78125) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_db.sqlalchemy.engines [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78125) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writer thread running {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG cinder.db.api [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Building query based on filter {{(pid=78125) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG cinder.image.image_utils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78125) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 04 12:13:27 devstack cinder-volume[78125]: INFO cinder.keymgr.migration [None req-0f876c14-e926-4536-a536-ae0f9bb420ac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:27 devstack sudo[78862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:27 devstack sudo[78862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:27 devstack sudo[78862]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:27 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:27 devstack sudo[78865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:27 devstack sudo[78865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:28 devstack sudo[78865]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:28 devstack sudo[78868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:28 devstack sudo[78868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:28 devstack sudo[78868]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:28 devstack sudo[78872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:28 devstack sudo[78872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:28 devstack sudo[78872]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG cinder.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Notifying Schedulers of capabilities ... {{(pid=78125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:13:28 devstack cinder-volume[78125]: INFO cinder.volume.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Driver initialization completed successfully. Aug 04 12:13:28 devstack cinder-volume[78125]: INFO cinder.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Initiating service 2 cleanup Aug 04 12:13:28 devstack cinder-volume[78125]: INFO cinder.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Service 2 cleanup completed. Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG cinder.service [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Creating RPC server for service cinder-volume {{(pid=78125) start /opt/stack/cinder/cinder/service.py:231}} Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG cinder.service [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78125) start /opt/stack/cinder/cinder/service.py:237}} Aug 04 12:13:28 devstack cinder-volume[78125]: INFO cinder.volume.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:13:28 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:28 devstack sudo[78879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:13:28 devstack sudo[78879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:29 devstack sudo[78879]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:29 devstack sudo[78884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:29 devstack sudo[78884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:29 devstack sudo[78884]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:29 devstack sudo[78891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:13:29 devstack sudo[78891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:29 devstack sudo[78891]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.369s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:29 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:13:29 devstack sudo[78998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:13:29 devstack sudo[78998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:13:30 devstack sudo[78998]: pam_unix(sudo:session): session closed for user root Aug 04 12:13:30 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:13:30 devstack cinder-volume[78125]: INFO cinder.volume.manager [None req-62f2ba63-b181-4cf7-8b2d-39ca103a5a56 None None] Driver post RPC initialization completed successfully. Aug 04 12:13:31 devstack cinder-volume[77841]: DEBUG dbcounter [-] [77841] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:13:40 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:13:40 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:14:11 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager._thread_info {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:14:11 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread count: 6 {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:14:11 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread info: [<_MainThread(MainThread, started 132857233440896)>, , , , , ] {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:15:11 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:15:11 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:15:11 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:15:11 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:15:11 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:15:11 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:15:11 devstack sudo[84085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:15:11 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:15:11 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:15:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:15:11 devstack sudo[84088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:15:11 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:15:12 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root Aug 04 12:15:12 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:15:12 devstack cinder-volume[78125]: DEBUG cinder.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Notifying Schedulers of capabilities ... {{(pid=78125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:15:12 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager._thread_info {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:15:12 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread count: 6 {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:15:12 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread info: [<_MainThread(MainThread, started 132857233440896)>, , , , , ] {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:15:40 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:16:11 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:16:11 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:16:11 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:16:11 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:16:11 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:16:11 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:16:11 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:16:11 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:16:11 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:16:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:16:11 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:16:11 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:16:12 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Aug 04 12:16:12 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:16:12 devstack cinder-volume[78125]: DEBUG cinder.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Notifying Schedulers of capabilities ... {{(pid=78125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:16:12 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager._thread_info {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:16:12 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread count: 6 {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:16:12 devstack cinder-volume[78125]: DEBUG cinder.volume.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] thread info: [<_MainThread(MainThread, started 132857233440896)>, , , , , ] {{(pid=78125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_service.periodic_task [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG cinder.volume.drivers.lvm [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Updating volume stats {{(pid=78125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:11 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 04 12:17:11 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:11 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:11 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:17:11 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:11 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:11 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 04 12:17:11 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:11 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:11 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:11 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 04 12:17:11 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:12 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:12 devstack cinder-volume[78125]: DEBUG oslo_concurrency.processutils [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:12 devstack cinder-volume[78125]: DEBUG cinder.manager [None req-8a204dd2-8939-4fa5-ab3d-4f5935d0c94a None None] Notifying Schedulers of capabilities ... {{(pid=78125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:17:40 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writing DB stats cinder:SELECT=1 {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:17:40 devstack cinder-volume[78125]: DEBUG dbcounter [-] [78125] Writing DB stats cinder:UPDATE=1 {{(pid=78125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:17:51 devstack cinder-volume[77841]: INFO oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Caught SIGTERM, stopping children Aug 04 12:17:51 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Acquiring lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:17:51 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Acquired lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:17:51 devstack cinder-volume[77841]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Releasing lock "singleton_lock" {{(pid=77841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:17:51 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Stop services. {{(pid=77841) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 04 12:17:51 devstack cinder-volume[77841]: DEBUG oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Killing children. {{(pid=77841) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 04 12:17:51 devstack cinder-volume[77841]: INFO oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Waiting on 1 children to exit Aug 04 12:17:53 devstack cinder-volume[78125]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Acquiring lock "singleton_lock" {{(pid=78125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:17:53 devstack cinder-volume[78125]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Acquired lock "singleton_lock" {{(pid=78125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:17:53 devstack cinder-volume[78125]: DEBUG oslo_concurrency.lockutils [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Releasing lock "singleton_lock" {{(pid=78125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:17:53 devstack cinder-volume[78125]: WARNING amqp [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 04 12:17:53 devstack cinder-volume[78125]: WARNING amqp [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 04 12:17:53 devstack cinder-volume[77841]: INFO oslo_service.backend._eventlet.service [None req-af969d8d-7086-4a35-aa08-8a1b7d4f5cdf None None] Child 78125 exited with status 0 Aug 04 12:17:54 devstack cinder-volume[88128]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 04 12:17:54 devstack cinder-volume[88128]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 04 12:17:54 devstack cinder-volume[88128]: we strongly recommend against using it for new projects. Aug 04 12:17:54 devstack cinder-volume[88128]: If you are already using Eventlet, we recommend migrating to a different Aug 04 12:17:54 devstack cinder-volume[88128]: framework. For more detail see Aug 04 12:17:54 devstack cinder-volume[88128]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 04 12:17:54 devstack cinder-volume[88128]: import eventlet # noqa Aug 04 12:17:56 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:17:56 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:17:56 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:17:57 devstack cinder-volume[88128]: INFO dbcounter [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Registered counter for database cinder Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_db.sqlalchemy.engines [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG dbcounter [-] [88128] Writer thread running {{(pid=88128) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:17:57 devstack cinder-volume[88128]: INFO cinder.rpc [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 04 12:17:57 devstack cinder-volume[88128]: INFO cinder.rpc [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_db.sqlalchemy.engines [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:17:57 devstack cinder-volume[88128]: INFO cinder.volume.manager [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Determined volume DB was empty at startup. Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG cinder.volume.manager [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88128) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 04 12:17:57 devstack cinder-volume[88128]: INFO cinder.volume.manager [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 04 12:17:57 devstack cinder-volume[88128]: WARNING stevedore.named [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 04 12:17:57 devstack cinder-volume[88128]: WARNING castellan.key_manager [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:17:57 devstack cinder-volume[88128]: WARNING cinder.keymgr.conf_key_mgr [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:17:57 devstack cinder-volume[88128]: INFO cinder.volume.manager [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_db.sqlalchemy.engines [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88128) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:17:57 devstack cinder-volume[88128]: INFO oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Starting 1 workers Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Started child 88345 {{(pid=88128) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Full set of CONF: {{(pid=88128) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] ******************************************************************************** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Configuration options gathered from: {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] ================================================================================ {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] allow_availability_zone_fallback = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] allow_compression_on_image_upload = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] allowed_direct_url_schemes = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] api_rate_limit = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] auth_strategy = keystone {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_availability_zone = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_host = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_stats_polling_interval = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backup_api_class = cinder.backup.api.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backup_name_template = backup-%s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backup_use_same_host = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backup_use_temp_snapshot = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] chap_password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] chap_username = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88345]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_internal_tenant_project_id = 13cc7a0997c64455a7e4c70ae1194509 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_internal_tenant_user_id = 9949b5801eab4613b8d3cb6e3801b462 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cluster = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] compression_format = gzip {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] compute_api_class = cinder.compute.nova.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] config_dir = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] config_source = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] control_exchange = openstack {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] debug = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] default_availability_zone = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] default_group_type = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] default_volume_type = QuobyteHD {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] disk_geometry = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_client_cert = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_client_cert_key = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_data_namespace = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_ssl_cert_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_ssl_cert_verify = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] driver_use_ssl = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] enable_new_services = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] enable_unsupported_driver = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] enabled_backends = ['QuobyteHD'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] enforce_multipath_for_image_xfer = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] filter_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_api_insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_api_ssl_compression = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_ca_certificates_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_catalog_info = image:glance:publicURL {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_num_retries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance_request_timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] goodness_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] graceful_shutdown_timeout = 5 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] group_api_class = cinder.group.api.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] host = devstack {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_compress_on_upload = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_conversion_address_space_limit = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_conversion_cpu_limit = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_conversion_disable = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_upload_use_cinder_backend = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_upload_use_internal_tenant = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_volume_cache_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_volume_cache_max_count = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] image_volume_cache_max_size_gb = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] init_host_max_objects_retrieval = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] instance_format = [instance: %(uuid)s] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iscsi_target_flags = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iscsi_write_cache = on {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iser_helper = tgtadm {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iser_ip_address = 192.168.122.136 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iser_port = 3260 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_color = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_config_append = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_dir = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_options = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_rotate_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_rotate_interval_type = days {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] log_rotation_type = none {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] max_age = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] max_logfile_count = 30 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] max_logfile_size_mb = 200 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] max_over_subscription_ratio = 20.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] message_reap_interval = 86400 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] message_ttl = 2592000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] migration_create_volume_timeout_secs = 300 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] monkey_patch = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] monkey_patch_modules = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] my_ip = 192.168.122.136 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] no_snapshot_gb_quota = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] num_iser_scan_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] num_shell_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] num_volume_device_scan_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] nvmeof_conn_info_version = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] nvmet_ns_id = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] nvmet_port_id = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_max_limit = 1000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_ext_list = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_listen = 0.0.0.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_listen_port = 8776 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_use_ssl = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] osapi_volume_workers = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] per_volume_size_limit = -1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] periodic_fuzzy_delay = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] periodic_interval = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] project_id_regex = [0-9a-f\-]+ {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] public_endpoint = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] publish_errors = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_backup_gigabytes = 1000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_backups = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_gigabytes = 1000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_groups = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_snapshots = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] quota_volumes = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] rate_limit_burst = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] rate_limit_except_level = CRITICAL {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] rate_limit_interval = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] reinit_driver_count = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] replication_device = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] report_discard_supported = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] report_interval = 120 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] reservation_clean_interval = 86400 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] reservation_expire = 86400 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] reserved_image_namespaces = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] reserved_percentage = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] rpc_response_timeout = 120 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] run_external_periodic_tasks = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] scst_target_driver = iscsi {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] scst_target_iqn_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_down_time = 720 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] shell_completion = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] snapshot_name_template = snapshot-%s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] split_loggers = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] state_path = /opt/stack/data/cinder {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] storage_availability_zone = nova {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:57 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] storage_protocol = iSCSI {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] syslog_log_facility = LOG_USER {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_helper = lioadm {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_ip_address = 192.168.122.136 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_port = 3260 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_protocol = iscsi {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] target_secondary_ip_addresses = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] trace_flags = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] transfer_api_class = cinder.transfer.api.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] transport_url = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] until_refresh = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_chap_auth = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_default_quota_class = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_journal = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_json = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_multipath_for_image_xfer = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_stderr = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] use_syslog = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] verify_glance_signatures = enabled {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_api_class = cinder.volume.api.API {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_backend_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_clear = zero {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_clear_ionice = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_clear_size = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_copy_bps_limit = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_dd_blocksize = 1M {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_name_template = volume-%s {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_service_inithost_offload = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88345]: INFO cinder.volume.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Starting volume driver QuobyteDriver (1.2) Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volume_usage_audit_period = month {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88345) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] zoning_mode = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_concurrency.disable_process_locking = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.auth_section = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.auth_type = password {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.auth_version = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.cache = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.delay_auth_decision = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.http_connect_timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.include_service_catalog = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.interface = public {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_password = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcache_username = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.region_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.service_token_roles_required = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.service_type = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.token_cache_time = 300 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.backend = dogpile.cache.null {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.backend_argument = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.backend_expiration_time = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.config_prefix = cache.oslo {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.debug_cache_backend = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.enable_retry_client = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.enable_socket_keepalive = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.expiration_time = 600 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.hashclient_retry_attempts = 2 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_dead_retry = 300 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_pool_maxsize = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_sasl_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.proxies = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.redis_db = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.redis_sentinel_service_name = mymaster {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.redis_server = localhost:6379 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.retry_attempts = 2 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.retry_delay = 0.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.socket_keepalive_count = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.socket_keepalive_idle = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.socket_keepalive_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.socket_timeout = 1.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.tls_allowed_ciphers = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.tls_cafile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.tls_certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.tls_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.tls_keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cache.username = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] coordination.backend_url = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.asyncio_connection = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.asyncio_slave_connection = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.backend = sqlalchemy {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.connection = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.connection_debug = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.connection_parameters = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.connection_recycle_time = 3600 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.connection_trace = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.db_inc_retry_interval = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.db_max_retries = 20 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.db_max_retry_interval = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.db_retry_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.max_overflow = 50 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.max_pool_size = 5 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.max_retries = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.mysql_wsrep_sync_wait = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.pool_timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.retry_interval = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.slave_connection = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.sqlite_synchronous = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.synchronous_reader = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] database.use_db_reconnect = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.connection_string = messaging:// {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.es_doc_type = notification {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.es_scroll_size = 10000 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.es_scroll_time = 2m {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.filter_error_trace = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.hmac_keys = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.sentinel_service_name = mymaster {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.socket_timeout = 0.1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.trace_requests = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler.trace_sqlalchemy = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler_jaeger.process_tags = {} {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler_jaeger.service_name_prefix = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] profiler_otlp.service_name_prefix = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.enforce_new_defaults = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.policy_default_rule = default {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.policy_file = policy.yaml {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88345) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88345]: WARNING cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_policy.remote_timeout = 60.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88345]: WARNING cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.group = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.helper_command = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Running cmd (subprocess): mount.quobyte {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] privsep_osbrick.user = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.group = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.helper_command = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] cinder_sys_admin.user = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.auth_section = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.auth_type = password {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.cafile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.collect_timing = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.send_service_user_token = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.split_loggers = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] service_user.timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.auth_section = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.auth_type = password {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.collect_timing = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.region_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.split_loggers = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] glance.timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.backend_availability_zone = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.chap_password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.chap_username = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.disk_geometry = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_client_cert = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_client_cert_key = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_data_namespace = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.driver_use_ssl = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.enable_unsupported_driver = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.extra_capabilities = {} {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.filter_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.goodness_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iscsi_target_flags = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iscsi_write_cache = on {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iser_helper = tgtadm {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iser_port = 3260 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_host = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_login = admin {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_mount_options = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_private_key = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_share_path = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_ssh_port = 22 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.num_shell_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.nvmet_port_id = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_client_cfg = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.quobyte_volume_url = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.replication_device = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.report_discard_supported = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.reserved_percentage = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.scst_target_driver = iscsi {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.scst_target_iqn_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.storage_protocol = iSCSI {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_helper = tgtadm {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_port = 3260 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_protocol = iscsi {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.trace_flags = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.unique_fqdn_network = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.use_chap_auth = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_backend_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_clear = zero {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_clear_ionice = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_clear_size = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_reports.file_event_handler = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_reports.log_dir = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.backend_availability_zone = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.backend_host = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.chap_password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.chap_username = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.chiscsi_conf = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.disk_geometry = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_client_cert = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_client_cert_key = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_data_namespace = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.driver_use_ssl = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.extra_capabilities = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.filter_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.goodness_function = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iscsi_target_flags = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iscsi_write_cache = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iser_helper = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iser_ip_address = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iser_port = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.iser_target_prefix = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_host = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_login = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_mount_options = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_password = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_private_key = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_share_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_ssh_port = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.num_shell_tries = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nvmet_ns_id = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.nvmet_port_id = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.replication_device = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.report_discard_supported = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.reserved_percentage = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.scst_target_driver = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.storage_protocol = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_helper = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_ip_address = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_port = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_prefix = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_protocol = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.trace_flags = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.unique_fqdn_network = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.use_chap_auth = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_clear = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_clear_ionice = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_clear_size = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] QuobyteHD.volumes_dir = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.ssl_version = {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_notifications.driver = [] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_notifications.retry = -1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] oslo_messaging_notifications.transport_url = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] key_manager.fixed_key = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.barbican_api_version = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.barbican_endpoint = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.barbican_endpoint_type = public {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.barbican_region_name = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.cafile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.collect_timing = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.number_of_retries = 60 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.retry_delay = 1 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.send_service_user_token = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.split_loggers = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.verify_ssl = True {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican.verify_ssl_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.auth_section = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.auth_type = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.cafile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.certfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.collect_timing = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.insecure = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.keyfile = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.split_loggers = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] barbican_service_user.timeout = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.approle_role_id = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.approle_secret_id = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.auth_method = approle {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.auth_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.kv_mountpoint = secret {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.kv_path = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.kv_version = 2 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.namespace = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.root_token_id = **** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.ssl_ca_crt_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.timeout = 60.0 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.token_file = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.token_role = None {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.use_ssl = False {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:17:58 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] ******************************************************************************** {{(pid=88128) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 04 12:17:58 devstack quobyte-client[88350]: Reading configuration file: /etc/quobyte/client.cfg Aug 04 12:17:58 devstack quobyte-client[88350]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:17:58 devstack cinder-volume[88345]: INFO cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 ... Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 -c /etc/quobyte/client-cinder.cfg {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:58 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 -c /etc/quobyte/client-cinder.cfg Aug 04 12:17:58 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:58 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.392s {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:58 devstack cinder-volume[88345]: INFO cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 succeeded Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.406s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:58 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:17:58 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:58 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.242s {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:58 devstack cinder-volume[88345]: INFO cinder.volume.driver [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Driver hasn't implemented _init_vendor_properties() Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.volume.driver [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG oslo_db.sqlalchemy.engines [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG dbcounter [-] [88345] Writer thread running {{(pid=88345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:17:58 devstack cinder-volume[88345]: DEBUG cinder.db.api [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Building query based on filter {{(pid=88345) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.image.image_utils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.keymgr.migration [None req-e3d1b1f3-1a14-4562-81e9-420612ec6a97 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:59 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:17:59 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:59 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.261s {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Notifying Schedulers of capabilities ... {{(pid=88345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.volume.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Driver initialization completed successfully. Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Initiating service 3 cleanup Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Service 3 cleanup completed. Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.service [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Creating RPC server for service cinder-volume {{(pid=88345) start /opt/stack/cinder/cinder/service.py:231}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.service [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88345) start /opt/stack/cinder/cinder/service.py:237}} Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.volume.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:17:59 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:17:59 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:17:59 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Aug 04 12:17:59 devstack cinder-volume[88345]: DEBUG oslo_concurrency.processutils [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.277s {{(pid=88345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:17:59 devstack cinder-volume[88345]: INFO cinder.volume.manager [None req-dbd4e553-a6e0-4958-8747-111bbd9b6002 None None] Driver post RPC initialization completed successfully. Aug 04 12:18:03 devstack cinder-volume[88128]: INFO oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Caught SIGTERM, stopping children Aug 04 12:18:03 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Acquiring lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:18:03 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Acquired lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:18:03 devstack cinder-volume[88128]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Releasing lock "singleton_lock" {{(pid=88128) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:18:03 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Stop services. {{(pid=88128) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 04 12:18:03 devstack cinder-volume[88128]: DEBUG oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Killing children. {{(pid=88128) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 04 12:18:03 devstack cinder-volume[88128]: INFO oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Waiting on 1 children to exit Aug 04 12:18:03 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Acquiring lock "singleton_lock" {{(pid=88345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:18:03 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Acquired lock "singleton_lock" {{(pid=88345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:18:03 devstack cinder-volume[88345]: DEBUG oslo_concurrency.lockutils [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Releasing lock "singleton_lock" {{(pid=88345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:18:03 devstack cinder-volume[88345]: WARNING amqp [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 04 12:18:03 devstack cinder-volume[88345]: WARNING amqp [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 04 12:18:03 devstack cinder-volume[88128]: INFO oslo_service.backend._eventlet.service [None req-d98c7231-4489-41d6-8262-4d9576c3858c None None] Child 88345 exited with status 0 Aug 04 12:18:04 devstack cinder-volume[88619]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 04 12:18:04 devstack cinder-volume[88619]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 04 12:18:04 devstack cinder-volume[88619]: we strongly recommend against using it for new projects. Aug 04 12:18:04 devstack cinder-volume[88619]: If you are already using Eventlet, we recommend migrating to a different Aug 04 12:18:04 devstack cinder-volume[88619]: framework. For more detail see Aug 04 12:18:04 devstack cinder-volume[88619]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 04 12:18:04 devstack cinder-volume[88619]: import eventlet # noqa Aug 04 12:18:07 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 04 12:18:07 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 04 12:18:07 devstack cinder-volume[88619]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88619) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 04 12:18:08 devstack cinder-volume[88619]: INFO dbcounter [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Registered counter for database cinder Aug 04 12:18:08 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:18:08 devstack cinder-volume[88619]: DEBUG dbcounter [-] [88619] Writer thread running {{(pid=88619) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:18:08 devstack cinder-volume[88619]: INFO cinder.rpc [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 04 12:18:08 devstack cinder-volume[88619]: INFO cinder.rpc [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:18:09 devstack cinder-volume[88619]: INFO cinder.volume.manager [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Determined volume DB was empty at startup. Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG cinder.volume.manager [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88619) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 04 12:18:09 devstack cinder-volume[88619]: WARNING stevedore.named [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 04 12:18:09 devstack cinder-volume[88619]: WARNING castellan.key_manager [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:18:09 devstack cinder-volume[88619]: WARNING cinder.keymgr.conf_key_mgr [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 04 12:18:09 devstack cinder-volume[88619]: INFO cinder.volume.manager [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_db.sqlalchemy.engines [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88619) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:18:09 devstack cinder-volume[88619]: INFO oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Starting 1 workers Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Started child 88895 {{(pid=88619) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Full set of CONF: {{(pid=88619) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] ******************************************************************************** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] Configuration options gathered from: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] ================================================================================ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] allow_availability_zone_fallback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] allow_compression_on_image_upload = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] allowed_direct_url_schemes = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88895]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] api_rate_limit = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] auth_strategy = keystone {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_stats_polling_interval = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backup_api_class = cinder.backup.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backup_name_template = backup-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backup_use_same_host = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backup_use_temp_snapshot = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] chap_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_internal_tenant_project_id = 13cc7a0997c64455a7e4c70ae1194509 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_internal_tenant_user_id = 9949b5801eab4613b8d3cb6e3801b462 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cluster = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] compression_format = gzip {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] compute_api_class = cinder.compute.nova.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] config_dir = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] config_source = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] control_exchange = openstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] debug = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] default_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] default_group_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] default_volume_type = QuobyteHD {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_ssl_cert_verify = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] driver_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] enable_new_services = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] enable_unsupported_driver = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] enabled_backends = ['QuobyteHD'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] enforce_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_api_insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_api_ssl_compression = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_ca_certificates_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_catalog_info = image:glance:publicURL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_num_retries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance_request_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] graceful_shutdown_timeout = 5 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] group_api_class = cinder.group.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] host = devstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_compress_on_upload = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_conversion_address_space_limit = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_conversion_cpu_limit = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_conversion_disable = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_upload_use_cinder_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_upload_use_internal_tenant = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_volume_cache_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_volume_cache_max_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] image_volume_cache_max_size_gb = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] init_host_max_objects_retrieval = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] instance_format = [instance: %(uuid)s] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iscsi_target_flags = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iscsi_write_cache = on {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iser_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iser_ip_address = 192.168.122.136 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iser_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_color = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_config_append = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_options = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_rotate_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_rotate_interval_type = days {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] log_rotation_type = none {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] max_age = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] max_logfile_count = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] max_logfile_size_mb = 200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] max_over_subscription_ratio = 20.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] message_reap_interval = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] message_ttl = 2592000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] migration_create_volume_timeout_secs = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] monkey_patch = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] monkey_patch_modules = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Starting volume driver QuobyteDriver (1.2) Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88895) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] my_ip = 192.168.122.136 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] no_snapshot_gb_quota = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] num_iser_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] num_shell_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] num_volume_device_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] nvmeof_conn_info_version = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] nvmet_ns_id = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] nvmet_port_id = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_max_limit = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_ext_list = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_listen = 0.0.0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_listen_port = 8776 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] osapi_volume_workers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] per_volume_size_limit = -1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] periodic_fuzzy_delay = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] periodic_interval = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] project_id_regex = [0-9a-f\-]+ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] public_endpoint = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] publish_errors = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_backup_gigabytes = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_backups = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_gigabytes = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_groups = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_snapshots = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] quota_volumes = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] rate_limit_burst = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] rate_limit_except_level = CRITICAL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] rate_limit_interval = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] reinit_driver_count = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] report_discard_supported = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] report_interval = 120 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] reservation_clean_interval = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] reservation_expire = 86400 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] reserved_image_namespaces = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] reserved_percentage = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] rpc_response_timeout = 120 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] run_external_periodic_tasks = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] scst_target_driver = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_down_time = 720 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] shell_completion = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] snapshot_name_template = snapshot-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] state_path = /opt/stack/data/cinder {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] storage_availability_zone = nova {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] storage_protocol = iSCSI {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] syslog_log_facility = LOG_USER {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_helper = lioadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_ip_address = 192.168.122.136 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_protocol = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] target_secondary_ip_addresses = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] transfer_api_class = cinder.transfer.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] transport_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] until_refresh = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_chap_auth = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_default_quota_class = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_journal = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_json = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_stderr = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] use_syslog = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] verify_glance_signatures = enabled {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_api_class = cinder.volume.api.API {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_clear = zero {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_clear_size = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_copy_bps_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_dd_blocksize = 1M {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_name_template = volume-%s {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_service_inithost_offload = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volume_usage_audit_period = month {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] zoning_mode = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_concurrency.disable_process_locking = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88895) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.auth_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.delay_auth_decision = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.http_connect_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Running cmd (subprocess): mount.quobyte {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.include_service_catalog = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.interface = public {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_password = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcache_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.service_token_roles_required = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.service_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.token_cache_time = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.backend = dogpile.cache.null {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.backend_argument = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.backend_expiration_time = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.config_prefix = cache.oslo {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.debug_cache_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.enable_retry_client = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.enable_socket_keepalive = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.expiration_time = 600 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.hashclient_retry_attempts = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_dead_retry = 300 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_pool_maxsize = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_sasl_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.proxies = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.redis_db = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.redis_sentinel_service_name = mymaster {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.redis_server = localhost:6379 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.retry_attempts = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.retry_delay = 0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.socket_keepalive_count = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.socket_keepalive_idle = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.socket_keepalive_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.socket_timeout = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.tls_allowed_ciphers = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.tls_cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.tls_certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.tls_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.tls_keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cache.username = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] coordination.backend_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.asyncio_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.asyncio_slave_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.backend = sqlalchemy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.connection_debug = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.connection_parameters = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.connection_recycle_time = 3600 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.connection_trace = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.db_inc_retry_interval = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.db_max_retries = 20 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.db_max_retry_interval = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.db_retry_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.max_overflow = 50 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.max_pool_size = 5 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.max_retries = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.mysql_wsrep_sync_wait = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.pool_timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.retry_interval = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.slave_connection = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.sqlite_synchronous = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.synchronous_reader = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] database.use_db_reconnect = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.connection_string = messaging:// {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.es_doc_type = notification {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.es_scroll_size = 10000 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.es_scroll_time = 2m {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.filter_error_trace = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.hmac_keys = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.sentinel_service_name = mymaster {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.socket_timeout = 0.1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.trace_requests = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler.trace_sqlalchemy = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler_jaeger.process_tags = {} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler_jaeger.service_name_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] profiler_otlp.service_name_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.enforce_new_defaults = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.policy_default_rule = default {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.policy_file = policy.yaml {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_policy.remote_timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.group = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.helper_command = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] privsep_osbrick.user = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.group = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.helper_command = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] cinder_sys_admin.user = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.send_service_user_token = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] service_user.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.auth_type = password {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] glance.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.chap_username = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.driver_use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.enable_unsupported_driver = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.extra_capabilities = {} {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iscsi_target_flags = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iscsi_write_cache = on {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iser_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iser_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_host = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_login = admin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack quobyte-client[88898]: Reading configuration file: /etc/quobyte/client.cfg Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_mount_options = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_private_key = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_share_path = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack quobyte-client[88898]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_ssh_port = 22 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.num_shell_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.nvmet_port_id = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_client_cfg = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.quobyte_volume_url = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.report_discard_supported = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.reserved_percentage = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.scst_target_driver = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.storage_protocol = iSCSI {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_helper = tgtadm {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_port = 3260 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_protocol = iscsi {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.unique_fqdn_network = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.use_chap_auth = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_backend_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_clear = zero {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_clear_size = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_reports.file_event_handler = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_reports.log_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.backend_availability_zone = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.backend_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:18:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.chap_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.chap_username = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.chiscsi_conf = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.disk_geometry = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_client_cert = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_client_cert_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_data_namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.driver_use_ssl = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.extra_capabilities = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.filter_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.goodness_function = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iscsi_target_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iscsi_write_cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iser_helper = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iser_ip_address = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iser_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.iser_target_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_host = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_login = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_mount_options = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_password = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_private_key = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_share_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_ssh_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.num_shell_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nvmet_ns_id = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.nvmet_port_id = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.replication_device = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.report_discard_supported = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.reserved_percentage = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.scst_target_driver = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.storage_protocol = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_helper = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_ip_address = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_port = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_prefix = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_protocol = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.trace_flags = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.unique_fqdn_network = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.use_chap_auth = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_clear = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_clear_ionice = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_clear_size = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] QuobyteHD.volumes_dir = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:18:09 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.ssl_version = {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_notifications.driver = [] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_notifications.retry = -1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] oslo_messaging_notifications.transport_url = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] key_manager.fixed_key = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.barbican_api_version = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.barbican_endpoint = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.barbican_endpoint_type = public {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.barbican_region_name = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.number_of_retries = 60 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.retry_delay = 1 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.send_service_user_token = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.verify_ssl = True {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican.verify_ssl_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.auth_section = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.auth_type = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.cafile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.certfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.collect_timing = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.insecure = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.keyfile = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.split_loggers = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] barbican_service_user.timeout = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.approle_role_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.approle_secret_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.auth_method = approle {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.auth_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.kv_mountpoint = secret {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.kv_path = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.kv_version = 2 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.namespace = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.root_token_id = **** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.ssl_ca_crt_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.timeout = 60.0 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.token_file = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.token_role = None {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.use_ssl = False {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 04 12:18:09 devstack cinder-volume[88619]: DEBUG oslo_service.backend._eventlet.service [None req-fbdfbada-ee48-4c93-93a7-f326849f3fba None None] ******************************************************************************** {{(pid=88619) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 04 12:18:10 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.471s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.volume.driver [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Driver hasn't implemented _init_vendor_properties() Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.volume.driver [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88895) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writer thread running {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.db.api [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Building query based on filter {{(pid=88895) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88895) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.keymgr.migration [None req-c6d4d71c-cacc-474b-a31c-8318425f13f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 04 12:18:10 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:18:10 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:18:10 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.291s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Driver initialization completed successfully. Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Initiating service 3 cleanup Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Service 3 cleanup completed. Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.service [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Creating RPC server for service cinder-volume {{(pid=88895) start /opt/stack/cinder/cinder/service.py:231}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.service [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88895) start /opt/stack/cinder/cinder/service.py:237}} Aug 04 12:18:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:18:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:18:10 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:18:10 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:18:11 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Aug 04 12:18:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:18:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cd2c2a32-ac6a-45be-ad10-19e9456bd42c None None] Driver post RPC initialization completed successfully. Aug 04 12:18:19 devstack cinder-volume[88619]: DEBUG dbcounter [-] [88619] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88619) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:18:20 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=3 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:18:21 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:19:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:19:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 6 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:19:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Flow 'volume_create_manager' (4ed7bc84-14b9-4c90-8e73-43b1a5fd7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022644cf-9429-48f1-84f0-61b7d195bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022644cf-9429-48f1-84f0-61b7d195bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-964748205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005fde69-cd46-48e0-8007-f3a134df0861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dedcfd60fa444c6b9005ec0d2bc1431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:11Z,use_quota=True,user_id='9f29264f789d4086846438c39034719a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d9f289-1949-466a-909e-fbf54779b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d9f289-1949-466a-909e-fbf54779b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc5e9f1-6be0-47b6-9c1e-8b50087d9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc5e9f1-6be0-47b6-9c1e-8b50087d9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005fde69-cd46-48e0-8007-f3a134df0861', 'volume_name': 'volume-005fde69-cd46-48e0-8007-f3a134df0861', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680e21ef-dbc3-4376-90d2-89657f8f3383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680e21ef-dbc3-4376-90d2-89657f8f3383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1b47a6-d6ed-4dda-898e-549718809cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:10 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Volume 005fde69-cd46-48e0-8007-f3a134df0861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005fde69-cd46-48e0-8007-f3a134df0861', 'volume_size': 1} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-964748205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005fde69-cd46-48e0-8007-f3a134df0861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dedcfd60fa444c6b9005ec0d2bc1431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:11Z,use_quota=True,user_id='9f29264f789d4086846438c39034719a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Creating volume 005fde69-cd46-48e0-8007-f3a134df0861 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:19:10 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:19:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:10 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 1073741824 Aug 04 12:19:10 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:11 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 1073741824" returned: 0 in 0.790s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:11 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 Aug 04 12:19:11 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:12 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861" returned: 0 in 0.279s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1b47a6-d6ed-4dda-898e-549718809cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005fde69-cd46-48e0-8007-f3a134df0861', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b7690f-d13f-44ff-a598-8f12ea01adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:12 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Volume volume-005fde69-cd46-48e0-8007-f3a134df0861 (005fde69-cd46-48e0-8007-f3a134df0861): created successfully Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b7690f-d13f-44ff-a598-8f12ea01adfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Flow 'volume_create_manager' (4ed7bc84-14b9-4c90-8e73-43b1a5fd7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6a9d732d-21a8-49f2-a696-29b40b0b0a72 tempest-TaggedAttachmentsTest-1683412904 None] Created volume successfully. Aug 04 12:19:22 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:19:22 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Flow 'volume_create_manager' (7f9d1dc2-5bae-4ab6-abd5-f99bc89412c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e742e3-9ac5-4f75-a3dc-85c06fadec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e742e3-9ac5-4f75-a3dc-85c06fadec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1385688806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a60191f-cb0a-4b1f-b136-d9f2c322e424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538582d738c2431080a181626665e749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:43Z,use_quota=True,user_id='19123e45953248dca36c50001bfa998e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e82e7a-6a27-488f-b64a-ab8093684478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e82e7a-6a27-488f-b64a-ab8093684478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a991fc0a-0971-41cf-91dd-c89b8fa11ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a991fc0a-0971-41cf-91dd-c89b8fa11ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a60191f-cb0a-4b1f-b136-d9f2c322e424', 'volume_name': 'volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec07a5b6-9f1e-486d-85d6-6791a8e309d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec07a5b6-9f1e-486d-85d6-6791a8e309d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2e2ed8-4c7f-450d-8212-5a88624c170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:43 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Volume 3a60191f-cb0a-4b1f-b136-d9f2c322e424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424', 'volume_size': 1} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1385688806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a60191f-cb0a-4b1f-b136-d9f2c322e424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538582d738c2431080a181626665e749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:43Z,use_quota=True,user_id='19123e45953248dca36c50001bfa998e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Creating volume 3a60191f-cb0a-4b1f-b136-d9f2c322e424 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:19:43 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:43 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 1073741824 Aug 04 12:19:43 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:43 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 1073741824" returned: 0 in 0.560s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:43 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 Aug 04 12:19:43 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:44 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2e2ed8-4c7f-450d-8212-5a88624c170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f215b8cb-6165-4548-b7bd-fe8b88fd5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:44 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Volume volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 (3a60191f-cb0a-4b1f-b136-d9f2c322e424): created successfully Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f215b8cb-6165-4548-b7bd-fe8b88fd5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Flow 'volume_create_manager' (7f9d1dc2-5bae-4ab6-abd5-f99bc89412c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:44 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ac55890d-7903-4954-846c-0cda963a1155 tempest-AttachVolumeShelveTestJSON-1711993698 None] Created volume successfully. Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Flow 'volume_create_manager' (a342672d-ea2f-44cb-8f0e-0682c0ab52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ade4df-d680-4a1e-9c1c-3c0ca2270865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ade4df-d680-4a1e-9c1c-3c0ca2270865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-66891755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff89599a-f401-4dbe-8c6a-ccd8894e98ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa759ccb184ca598caaddd8699169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:46Z,use_quota=True,user_id='9f926a2244ab478fa3ead75cbe0eea40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dc3c52-cebb-495d-a197-232e519f16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dc3c52-cebb-495d-a197-232e519f16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5db1c8-f4a8-4d99-bded-c2b1d26d83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5db1c8-f4a8-4d99-bded-c2b1d26d83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'volume_name': 'volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26df4d8-eba9-4f4f-a771-216080947317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26df4d8-eba9-4f4f-a771-216080947317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca5a0ab-faca-4a12-8b47-adaaf56d87e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Volume ff89599a-f401-4dbe-8c6a-ccd8894e98ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'volume_size': 1} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-66891755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff89599a-f401-4dbe-8c6a-ccd8894e98ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa759ccb184ca598caaddd8699169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:19:46Z,use_quota=True,user_id='9f926a2244ab478fa3ead75cbe0eea40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Creating volume ff89599a-f401-4dbe-8c6a-ccd8894e98ef {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:19:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:19:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:45 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef 1073741824 Aug 04 12:19:45 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:46 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef 1073741824" returned: 0 in 0.826s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:19:46 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef Aug 04 12:19:46 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:19:47 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca5a0ab-faca-4a12-8b47-adaaf56d87e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f614791-6bc1-4d7f-895b-03023fc5409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:19:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Volume volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef (ff89599a-f401-4dbe-8c6a-ccd8894e98ef): created successfully Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f614791-6bc1-4d7f-895b-03023fc5409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:19:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Flow 'volume_create_manager' (a342672d-ea2f-44cb-8f0e-0682c0ab52d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:19:47 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a01dc01a-6874-4af6-b2c1-e3905e03c2f3 tempest-ServerActionsTestOtherA-1773772153 None] Created volume successfully. Aug 04 12:19:57 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:19:57 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:00 devstack cinder-volume[88895]: WARNING py.warnings [req-5ce1824a-2258-4b31-95e5-48f965569c68 req-68be14d1-8e37-4e85-994f-212d799d31c1 tempest-AttachVolumeShelveTestJSON-1711993698 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 04 12:20:00 devstack cinder-volume[88895]: .first() Aug 04 12:20:00 devstack cinder-volume[88895]: Aug 04 12:20:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-5ce1824a-2258-4b31-95e5-48f965569c68 req-68be14d1-8e37-4e85-994f-212d799d31c1 tempest-AttachVolumeShelveTestJSON-1711993698 None] No connector for attachment 189d4b07-42da-4e50-888f-29e99e5a24f4; skipping storage backend terminate_connection call. {{(pid=88895) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 04 12:20:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-5ce1824a-2258-4b31-95e5-48f965569c68 req-68be14d1-8e37-4e85-994f-212d799d31c1 tempest-AttachVolumeShelveTestJSON-1711993698 None] Deleting attachment 189d4b07-42da-4e50-888f-29e99e5a24f4. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:06 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:20:06 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:06 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.513s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 6 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:20:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:20:10 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-f8789ca7-bcb8-455d-9bb2-c5ac66ceaf0b req-ca7d1061-f4f4-4885-92f9-42ce057c4371 tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-f8789ca7-bcb8-455d-9bb2-c5ac66ceaf0b req-ca7d1061-f4f4-4885-92f9-42ce057c4371 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-f8789ca7-bcb8-455d-9bb2-c5ac66ceaf0b req-ca7d1061-f4f4-4885-92f9-42ce057c4371 tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-f8789ca7-bcb8-455d-9bb2-c5ac66ceaf0b req-ca7d1061-f4f4-4885-92f9-42ce057c4371 tempest-TaggedAttachmentsTest-1683412904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-005fde69-cd46-48e0-8007-f3a134df0861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90070ce3-f738-4cfd-bcf8-2daeaa5d5896', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:20:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-f8789ca7-bcb8-455d-9bb2-c5ac66ceaf0b req-ca7d1061-f4f4-4885-92f9-42ce057c4371 tempest-TaggedAttachmentsTest-1683412904 None] attachment_update completed successfully. Aug 04 12:20:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-2396f533-b4e3-4d7a-bcf5-ccaeb4324578 req-55c71d37-7a5b-40a0-bed7-542afe760e7f tempest-TaggedAttachmentsTest-1683412904 None] Terminate volume connection completed successfully. Aug 04 12:20:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-2396f533-b4e3-4d7a-bcf5-ccaeb4324578 req-55c71d37-7a5b-40a0-bed7-542afe760e7f tempest-TaggedAttachmentsTest-1683412904 None] Deleting attachment 90070ce3-f738-4cfd-bcf8-2daeaa5d5896. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-da864148-7c05-459d-b764-9448515b6b51 req-0f940d0d-f4a1-4444-b95f-4bceb9eaffed tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-da864148-7c05-459d-b764-9448515b6b51 req-0f940d0d-f4a1-4444-b95f-4bceb9eaffed tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-da864148-7c05-459d-b764-9448515b6b51 req-0f940d0d-f4a1-4444-b95f-4bceb9eaffed tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-da864148-7c05-459d-b764-9448515b6b51 req-0f940d0d-f4a1-4444-b95f-4bceb9eaffed tempest-ServerActionsTestOtherA-1773772153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df5fdd99-919b-478f-bc86-c26e08424a0f', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:20:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-da864148-7c05-459d-b764-9448515b6b51 req-0f940d0d-f4a1-4444-b95f-4bceb9eaffed tempest-ServerActionsTestOtherA-1773772153 None] attachment_update completed successfully. Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Flow 'volume_create_manager' (433686d3-53b6-4a95-82f1-2dadcaebf165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc8fb14-e8e8-4a6e-aa68-d9d694a54909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc8fb14-e8e8-4a6e-aa68-d9d694a54909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2116484859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3c4b12-e6d2-4a2f-9b01-d22543d18140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed90c6e07ad41e39b2c5e46ae6f0fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:20:29Z,use_quota=True,user_id='43b4e02d4c784c97a58298e48cf2c659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aa3202-f534-41cc-a36f-67fd93a5c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aa3202-f534-41cc-a36f-67fd93a5c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3607b32-6cf3-4c1e-9e97-45ae9938dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3607b32-6cf3-4c1e-9e97-45ae9938dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3c4b12-e6d2-4a2f-9b01-d22543d18140', 'volume_name': 'volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3803c4-dd9b-4439-85f1-8b157bb9f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3803c4-dd9b-4439-85f1-8b157bb9f671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d5977d-4862-4f57-8beb-547a550f63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Volume ec3c4b12-e6d2-4a2f-9b01-d22543d18140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140', 'volume_size': 1} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2116484859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3c4b12-e6d2-4a2f-9b01-d22543d18140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed90c6e07ad41e39b2c5e46ae6f0fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:20:29Z,use_quota=True,user_id='43b4e02d4c784c97a58298e48cf2c659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Creating volume ec3c4b12-e6d2-4a2f-9b01-d22543d18140 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:20:29 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:20:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:29 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 1073741824 Aug 04 12:20:29 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:30 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 1073741824" returned: 0 in 0.869s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:30 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 Aug 04 12:20:30 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:30 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d5977d-4862-4f57-8beb-547a550f63d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e922610-b185-4de4-ab9e-1818629144e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:20:30 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Volume volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 (ec3c4b12-e6d2-4a2f-9b01-d22543d18140): created successfully Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e922610-b185-4de4-ab9e-1818629144e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:20:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Flow 'volume_create_manager' (433686d3-53b6-4a95-82f1-2dadcaebf165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:20:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3b796fe7-9025-47da-a96d-814e3d9ffbaf tempest-VolumesAdminNegativeTest-1807214254 None] Created volume successfully. Aug 04 12:20:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Acquiring lock "cinder-ec3c4b12-e6d2-4a2f-9b01-d22543d18140-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "cinder-ec3c4b12-e6d2-4a2f-9b01-d22543d18140-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Acquiring lock "cinder-quobyte-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "cinder-quobyte-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:31 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6hsqii4a/privsep.sock'] Aug 04 12:20:31 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6hsqii4a/privsep.sock Aug 04 12:20:31 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-267deac6-d81b-4081-81c2-ed916402ea28 tempest-ServerActionsTestOtherA-1773772153 None] Terminate volume connection completed successfully. Aug 04 12:20:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-267deac6-d81b-4081-81c2-ed916402ea28 tempest-ServerActionsTestOtherA-1773772153 None] Deleting attachment df5fdd99-919b-478f-bc86-c26e08424a0f. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:20:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "cinder-005fde69-cd46-48e0-8007-f3a134df0861-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "cinder-005fde69-cd46-48e0-8007-f3a134df0861-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "cinder-quobyte-005fde69-cd46-48e0-8007-f3a134df0861" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "cinder-quobyte-005fde69-cd46-48e0-8007-f3a134df0861" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: Aug 04 12:20:33 devstack cinder-volume[88895]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-8650311a-b019-40ba-967f-df05fcae61e0 tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-8650311a-b019-40ba-967f-df05fcae61e0 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-8650311a-b019-40ba-967f-df05fcae61e0 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-8650311a-b019-40ba-967f-df05fcae61e0 tempest-ServerActionsTestOtherA-1773772153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1124c92a-ca13-4d02-abd0-1af777c5796c', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:20:34 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:34 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Spawned new privsep daemon via rootwrap Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Accepted privsep connection to /tmp/tmp6hsqii4a/privsep.sock {{(pid=88895) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 04 12:20:34 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 04 12:20:34 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 04 12:20:34 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 04 12:20:34 devstack cinder-volume[88895]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91703 Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff9110e-fa0b-4eeb-bf75-0d5f18f2a1a0]: (2,) {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:20:34 devstack cinder-volume[88895]: WARNING oslo_privsep.priv_context [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] privsep daemon already running Aug 04 12:20:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-b696f283-ddec-4d3e-a65d-2a173804c36e req-8650311a-b019-40ba-967f-df05fcae61e0 tempest-ServerActionsTestOtherA-1773772153 None] attachment_update completed successfully. Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1d0b3-a34d-4924-ae62-6995debd02f9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d01b5f-69e8-40a0-b041-7fc17f3e0ab3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:20:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:34 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 Aug 04 12:20:34 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:34 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 Aug 04 12:20:34 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:35 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" returned: 0 in 0.597s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:35 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861" returned: 0 in 0.645s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:35 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140 Aug 04 12:20:35 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:35 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861 Aug 04 12:20:35 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:35 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-005fde69-cd46-48e0-8007-f3a134df0861" returned: 0 in 0.542s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:35 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" returned: 0 in 0.604s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "cinder-quobyte-ec3c4b12-e6d2-4a2f-9b01-d22543d18140" released by "delete_volume" :: held 3.950s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "cinder-quobyte-005fde69-cd46-48e0-8007-f3a134df0861" released by "delete_volume" :: held 2.451s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:20:35 devstack cinder-volume[88895]: WARNING cinder.quota [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:20:35 devstack cinder-volume[88895]: WARNING cinder.quota [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Created reservations ['3b50e81e-584e-4ece-93f8-4fb547d8d32e', 'c0eb0a9f-5fcd-4205-b5ca-f2c009f1f974', '578d1fce-beb0-41dc-aa9f-de80efd6b575', '9c47540a-5ba0-4c6c-b01a-c974094923b6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:20:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Created reservations ['751ae2e9-76c9-4167-ac2d-e377934518ee', '4d216b9e-8172-4551-a5a6-47e58cd16895', '2fefffcb-a9c8-461e-9de4-4d480da72aa0', '73fc9be3-295c-4d21-9463-70d53b100b50'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:36 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:20:36 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:36 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:20:36 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:20:36 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Deleted volume successfully. Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98b2e6f5-3490-44d7-a0cc-3e5e67bf4ebb tempest-TaggedAttachmentsTest-1683412904 None] Lock "cinder-005fde69-cd46-48e0-8007-f3a134df0861-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:20:36 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.655s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:20:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Deleted volume successfully. Aug 04 12:20:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ddb887fb-d31b-4a6e-b732-4beed8b6dba9 tempest-VolumesAdminNegativeTest-1807214254 None] Lock "cinder-ec3c4b12-e6d2-4a2f-9b01-d22543d18140-delete_volume" released by "delete_volume" :: held 5.220s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:20:46 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=30,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:46 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Acquiring lock "cinder-3a60191f-cb0a-4b1f-b136-d9f2c322e424-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "cinder-3a60191f-cb0a-4b1f-b136-d9f2c322e424-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Acquiring lock "cinder-quobyte-3a60191f-cb0a-4b1f-b136-d9f2c322e424" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "cinder-quobyte-3a60191f-cb0a-4b1f-b136-d9f2c322e424" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[36643577-aada-4d2b-a7e9-569d2e28c314]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:20:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:51 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 Aug 04 12:20:51 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:52 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424" returned: 0 in 0.548s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:52 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424 Aug 04 12:20:52 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:52 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3a60191f-cb0a-4b1f-b136-d9f2c322e424" returned: 0 in 0.478s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "cinder-quobyte-3a60191f-cb0a-4b1f-b136-d9f2c322e424" released by "delete_volume" :: held 1.100s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:20:52 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Created reservations ['e60debd4-8750-43b7-bb2d-dd8ff6cd2bdc', 'fa4bb539-441b-44de-897f-28565c29bfc0', '4c810eb8-0368-49e9-ab31-955d9475d3b1', 'f0183cd4-7609-476b-85a2-d8bd8cbaba23'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:20:53 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:20:53 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:20:53 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.317s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:20:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Deleted volume successfully. Aug 04 12:20:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7461275f-f32e-49ff-98e0-4168110e47b9 tempest-AttachVolumeShelveTestJSON-1711993698 None] Lock "cinder-3a60191f-cb0a-4b1f-b136-d9f2c322e424-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:21:03 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:21:03 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:06 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:21:06 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:06 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:21:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-454ea7ea-225a-4f5b-8040-abe95058c560 req-f20912d3-275d-4e18-a1c4-afee645750f9 tempest-ServerActionsTestOtherA-1773772153 None] Terminate volume connection completed successfully. Aug 04 12:21:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-454ea7ea-225a-4f5b-8040-abe95058c560 req-f20912d3-275d-4e18-a1c4-afee645750f9 tempest-ServerActionsTestOtherA-1773772153 None] Deleting attachment 1124c92a-ca13-4d02-abd0-1af777c5796c. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:21:17 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:21:17 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Flow 'volume_create_manager' (847ce10a-efef-4ae2-b8c3-032a26d5bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ea7c6-91d5-490f-aa5b-0bad7ad5af19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ea7c6-91d5-490f-aa5b-0bad7ad5af19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080718836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e84b4b-df9a-4888-8a29-c99067577bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa759ccb184ca598caaddd8699169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:25Z,use_quota=True,user_id='9f926a2244ab478fa3ead75cbe0eea40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1844d97-5036-40cc-863b-a3e85e0dae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1844d97-5036-40cc-863b-a3e85e0dae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d46e5a8-5e0a-4b2b-ba05-a21266be461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:25 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d46e5a8-5e0a-4b2b-ba05-a21266be461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1e84b4b-df9a-4888-8a29-c99067577bb7', 'volume_name': 'volume-c1e84b4b-df9a-4888-8a29-c99067577bb7', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1750ff0f-b879-4818-9dc2-1558f49aa09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1750ff0f-b879-4818-9dc2-1558f49aa09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9437c539-ca77-480d-b548-6cb8cb76f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Volume c1e84b4b-df9a-4888-8a29-c99067577bb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1e84b4b-df9a-4888-8a29-c99067577bb7', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Trying to clone c1e84b4b-df9a-4888-8a29-c99067577bb7 from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:21:26 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Image download 20.69 MB at 20.69 MB/s Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab787298-f93c-464a-b49c-a50980e99f67]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:21:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:27 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD Aug 04 12:21:27 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:27 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:27 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 is fetched for user 9f926a2244ab478fa3ead75cbe0eea40. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:21:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b035ce8-43eb-4750-806c-d34faa0f04d0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:21:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:27 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD Aug 04 12:21:27 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:28 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD" returned: 0 in 1.136s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080718836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e84b4b-df9a-4888-8a29-c99067577bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa759ccb184ca598caaddd8699169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:25Z,use_quota=True,user_id='9f926a2244ab478fa3ead75cbe0eea40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Creating volume c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:21:28 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:21:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:28 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1073741824 Aug 04 12:21:28 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:29 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1073741824" returned: 0 in 0.907s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:29 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 Aug 04 12:21:29 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:30 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7" returned: 0 in 0.536s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Attempting download of 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume c1e84b4b-df9a-4888-8a29-c99067577bb7. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c08864-3556-4d93-8cec-d757c15da029]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:21:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:30 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc Aug 04 12:21:30 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:31 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc" returned: 0 in 0.724s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:31 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc Aug 04 12:21:31 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:31 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc" returned: 1 in 0.651s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_gkbjmkkc' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[91686a39-a0fb-4992-b7f4-2cf90c9474e7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:21:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:32 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD Aug 04 12:21:32 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:32 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD" returned: 0 in 1.053s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:32 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:21:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:33 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 Aug 04 12:21:33 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:37 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7" returned: 0 in 4.745s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:37 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_xnk6ev_kdevstack@QuobyteHD, size 112.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:21:37 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Converted 112.00 MB image at 23.58 MB/s Aug 04 12:21:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:37 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1G Aug 04 12:21:37 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:39 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 1G" returned: 0 in 1.517s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Downloaded image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume c1e84b4b-df9a-4888-8a29-c99067577bb7 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 for user 9f926a2244ab478fa3ead75cbe0eea40 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Marking volume c1e84b4b-df9a-4888-8a29-c99067577bb7 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Copying metadata from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 to c1e84b4b-df9a-4888-8a29-c99067577bb7. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Creating volume glance metadata for volume c1e84b4b-df9a-4888-8a29-c99067577bb7 backed by image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9437c539-ca77-480d-b548-6cb8cb76f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e84b4b-df9a-4888-8a29-c99067577bb7', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705d6b29-711b-4d5a-ab7a-296883004087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Volume volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 (c1e84b4b-df9a-4888-8a29-c99067577bb7): created successfully Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705d6b29-711b-4d5a-ab7a-296883004087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Flow 'volume_create_manager' (847ce10a-efef-4ae2-b8c3-032a26d5bea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d3faa913-62e3-4742-b411-7ff51e0fc0af tempest-ServerActionsTestOtherA-1773772153 None] Created volume successfully. Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Flow 'volume_create_manager' (66a7cc70-0cf9-4f06-940a-f4a4710dacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f241db6-9f8c-45f1-8305-c62585e5fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f241db6-9f8c-45f1-8305-c62585e5fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-474846381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8327602c-0826-4511-bc23-978a870b811f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a6194f13614b9e95e25b9bd0afd6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:41Z,use_quota=True,user_id='dd494db957c64fcb8a2dae26357fbb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c843a5-612c-4ae6-a927-0017169a2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c843a5-612c-4ae6-a927-0017169a2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd34fb-be3e-4207-9398-5fc8c8c1f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd34fb-be3e-4207-9398-5fc8c8c1f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8327602c-0826-4511-bc23-978a870b811f', 'volume_name': 'volume-8327602c-0826-4511-bc23-978a870b811f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25ac9c6-76aa-4c9f-b337-261f19e3f20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25ac9c6-76aa-4c9f-b337-261f19e3f20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139159e8-67be-4886-bed4-c0e0cb57a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Volume 8327602c-0826-4511-bc23-978a870b811f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8327602c-0826-4511-bc23-978a870b811f', 'volume_size': 1} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-474846381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8327602c-0826-4511-bc23-978a870b811f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a6194f13614b9e95e25b9bd0afd6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:41Z,use_quota=True,user_id='dd494db957c64fcb8a2dae26357fbb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Creating volume 8327602c-0826-4511-bc23-978a870b811f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:21:41 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:21:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:41 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f 1073741824 Aug 04 12:21:41 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:43 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f 1073741824" returned: 0 in 1.432s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:43 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f Aug 04 12:21:43 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:43 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f" returned: 0 in 0.476s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139159e8-67be-4886-bed4-c0e0cb57a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8327602c-0826-4511-bc23-978a870b811f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97350de6-aef6-4176-8232-8ac4c887cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:43 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Volume volume-8327602c-0826-4511-bc23-978a870b811f (8327602c-0826-4511-bc23-978a870b811f): created successfully Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97350de6-aef6-4176-8232-8ac4c887cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Flow 'volume_create_manager' (66a7cc70-0cf9-4f06-940a-f4a4710dacd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2078856d-a7da-4d4a-a890-b073c6c87915 tempest-DeleteServersTestJSON-351308081 None] Created volume successfully. Aug 04 12:21:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ac889a01-b447-43a9-bae4-6774498b0c29 req-4a01aead-b926-4ac9-ae53-e967a005ba3a tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ac889a01-b447-43a9-bae4-6774498b0c29 req-4a01aead-b926-4ac9-ae53-e967a005ba3a tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ac889a01-b447-43a9-bae4-6774498b0c29 req-4a01aead-b926-4ac9-ae53-e967a005ba3a tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-ac889a01-b447-43a9-bae4-6774498b0c29 req-4a01aead-b926-4ac9-ae53-e967a005ba3a tempest-DeleteServersTestJSON-351308081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-8327602c-0826-4511-bc23-978a870b811f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5de7546e-f4c3-4fd2-aec0-27e7e31447c9', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:21:47 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-ac889a01-b447-43a9-bae4-6774498b0c29 req-4a01aead-b926-4ac9-ae53-e967a005ba3a tempest-DeleteServersTestJSON-351308081 None] attachment_update completed successfully. Aug 04 12:21:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-611632c3-9f60-4ffc-86da-b16e82344437 req-9f52c4a8-b4b1-4f65-80be-c966e8e27af3 tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-611632c3-9f60-4ffc-86da-b16e82344437 req-9f52c4a8-b4b1-4f65-80be-c966e8e27af3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-611632c3-9f60-4ffc-86da-b16e82344437 req-9f52c4a8-b4b1-4f65-80be-c966e8e27af3 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-611632c3-9f60-4ffc-86da-b16e82344437 req-9f52c4a8-b4b1-4f65-80be-c966e8e27af3 tempest-ServerActionsTestOtherA-1773772153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-c1e84b4b-df9a-4888-8a29-c99067577bb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc521e7b-7501-4225-9d6f-3195993cf8fb', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:21:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-611632c3-9f60-4ffc-86da-b16e82344437 req-9f52c4a8-b4b1-4f65-80be-c966e8e27af3 tempest-ServerActionsTestOtherA-1773772153 None] attachment_update completed successfully. Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Flow 'volume_create_manager' (88b4a4ee-8547-4c15-a41f-507bc4835914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fe6d1f-3ba3-40d0-bf42-c773afb2572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23fe6d1f-3ba3-40d0-bf42-c773afb2572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1540106241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724a2b86-67b8-4678-be1b-e523ebb14b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf554f55c19460eb6ddae0d92ce3ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:50Z,use_quota=True,user_id='378b1bfad2604396a67bd41b33143c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94c14bc-2536-47f4-a8c3-6c47d939d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94c14bc-2536-47f4-a8c3-6c47d939d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d5297-fce2-4ad7-8440-61cb27918af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97d5297-fce2-4ad7-8440-61cb27918af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724a2b86-67b8-4678-be1b-e523ebb14b68', 'volume_name': 'volume-724a2b86-67b8-4678-be1b-e523ebb14b68', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db33bc4-402e-4612-8a7e-8351848bd037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db33bc4-402e-4612-8a7e-8351848bd037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83185571-1880-46b6-baad-b86dd8e04d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Volume 724a2b86-67b8-4678-be1b-e523ebb14b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724a2b86-67b8-4678-be1b-e523ebb14b68', 'volume_size': 1} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1540106241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724a2b86-67b8-4678-be1b-e523ebb14b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf554f55c19460eb6ddae0d92ce3ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:21:50Z,use_quota=True,user_id='378b1bfad2604396a67bd41b33143c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Creating volume 724a2b86-67b8-4678-be1b-e523ebb14b68 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:21:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:21:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:50 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 1073741824 Aug 04 12:21:50 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:52 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 1073741824" returned: 0 in 1.629s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:21:52 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 Aug 04 12:21:52 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:21:53 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68" returned: 0 in 0.779s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83185571-1880-46b6-baad-b86dd8e04d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724a2b86-67b8-4678-be1b-e523ebb14b68', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8037fb23-241d-476b-9a50-7b40dd5632ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:21:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Volume volume-724a2b86-67b8-4678-be1b-e523ebb14b68 (724a2b86-67b8-4678-be1b-e523ebb14b68): created successfully Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8037fb23-241d-476b-9a50-7b40dd5632ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:21:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Flow 'volume_create_manager' (88b4a4ee-8547-4c15-a41f-507bc4835914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:21:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0d00dd54-4d26-4eb6-8d27-dfac77febfb7 tempest-ServerRescueNegativeTestJSON-275322616 None] Created volume successfully. Aug 04 12:21:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-21d8bfd7-2323-49a8-92fe-5e40ccae7e0d req-2d38ec4e-20b5-4d0f-b609-63abcfd9b6ca tempest-DeleteServersTestJSON-351308081 None] Terminate volume connection completed successfully. Aug 04 12:21:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-21d8bfd7-2323-49a8-92fe-5e40ccae7e0d req-2d38ec4e-20b5-4d0f-b609-63abcfd9b6ca tempest-DeleteServersTestJSON-351308081 None] Deleting attachment 5de7546e-f4c3-4fd2-aec0-27e7e31447c9. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "cinder-8327602c-0826-4511-bc23-978a870b811f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "cinder-8327602c-0826-4511-bc23-978a870b811f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "cinder-quobyte-8327602c-0826-4511-bc23-978a870b811f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "cinder-quobyte-8327602c-0826-4511-bc23-978a870b811f" acquired by "delete_volume" :: waited 0.053s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a83eca-3798-47f5-a962-411da9f4d62c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:01 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f Aug 04 12:22:01 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:02 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f" returned: 0 in 0.884s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:02 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f Aug 04 12:22:02 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:02 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8327602c-0826-4511-bc23-978a870b811f" returned: 0 in 0.393s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "cinder-quobyte-8327602c-0826-4511-bc23-978a870b811f" released by "delete_volume" :: held 1.366s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Created reservations ['b653131b-4ef0-49ce-843a-93f39a917535', '8bd958df-b15c-4173-8301-8537b980f043', '364d70b7-7cef-4f8a-bad0-18b9f5d8a49b', '3035b69e-6c7c-48b4-9398-6f2f5c74ec32'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:03 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:22:03 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:04 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.890s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:22:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Deleted volume successfully. Aug 04 12:22:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-afcb4e47-0a49-453f-8f8d-261d74bc3e4b tempest-DeleteServersTestJSON-351308081 None] Lock "cinder-8327602c-0826-4511-bc23-978a870b811f-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:06 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:22:06 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:06 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.432s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:22:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:22:14 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=34,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=4 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=32,cinder:INSERT=12,cinder:UPDATE=22 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Flow 'volume_create_manager' (ae8acbf4-b235-4f74-9203-44d5596aba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d1a9c5-8524-466c-b02e-8550feba4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d1a9c5-8524-466c-b02e-8550feba4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-985274741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f37f7665481459b8997340accd75a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:20Z,use_quota=True,user_id='4625b5cdc5d14efd86b1da011efc135e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857381c0-ed1b-4ae9-abbf-daccd445e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857381c0-ed1b-4ae9-abbf-daccd445e075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e15180-8ee0-4e90-ad05-9abe0d69d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e15180-8ee0-4e90-ad05-9abe0d69d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2', 'volume_name': 'volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfff2bb1-5375-471e-8876-5f5f3e54ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfff2bb1-5375-471e-8876-5f5f3e54ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db032a2-79bc-4c05-aee2-08b4624b33d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:19 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Volume 95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2', 'volume_size': 1} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-985274741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f37f7665481459b8997340accd75a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:20Z,use_quota=True,user_id='4625b5cdc5d14efd86b1da011efc135e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Creating volume 95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:19 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:20 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 1073741824 Aug 04 12:22:20 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Acquiring lock "cinder-724a2b86-67b8-4678-be1b-e523ebb14b68-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "cinder-724a2b86-67b8-4678-be1b-e523ebb14b68-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Acquiring lock "cinder-quobyte-724a2b86-67b8-4678-be1b-e523ebb14b68" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "cinder-quobyte-724a2b86-67b8-4678-be1b-e523ebb14b68" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bc063-4e95-49d8-ac2b-200b45297565]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:20 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 Aug 04 12:22:20 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:20 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 1073741824" returned: 0 in 0.737s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:20 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 Aug 04 12:22:20 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:21 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68" returned: 0 in 0.724s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:21 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68 Aug 04 12:22:21 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:21 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" returned: 0 in 0.617s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db032a2-79bc-4c05-aee2-08b4624b33d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376f05e8-4b9c-40aa-b3fb-ada49e36c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Volume volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 (95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2): created successfully Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376f05e8-4b9c-40aa-b3fb-ada49e36c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Flow 'volume_create_manager' (ae8acbf4-b235-4f74-9203-44d5596aba66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-31018b12-75cd-419f-babc-490b0b4e1c2e tempest-ServerActionsTestOtherA-1773772153 None] Terminate volume connection completed successfully. Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-31018b12-75cd-419f-babc-490b0b4e1c2e tempest-ServerActionsTestOtherA-1773772153 None] Deleting attachment cc521e7b-7501-4225-9d6f-3195993cf8fb. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:22:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-88813000-4513-4bb0-a694-eff94e7a5be0 req-9ed1b3aa-45af-4df4-8faa-5cd812f3e9ac tempest-VolumesSnapshotsTestJSON-136513573 None] Created volume successfully. Aug 04 12:22:21 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-724a2b86-67b8-4678-be1b-e523ebb14b68" returned: 0 in 0.573s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "cinder-quobyte-724a2b86-67b8-4678-be1b-e523ebb14b68" released by "delete_volume" :: held 1.352s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Created reservations ['c594301e-2f1e-470c-a477-72cfb0225554', '358d8707-bf4e-4612-b10d-fd8bdd8f1694', '461df4c1-35da-4fd3-82bc-0a635d8fa0c6', '4ff59417-9af2-4bf8-996a-c664cbc1c17a'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:22 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:22:22 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:22:22 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Deleted volume successfully. Aug 04 12:22:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0774e401-1e96-4ef0-a4e9-846475b0a729 tempest-ServerRescueNegativeTestJSON-275322616 None] Lock "cinder-724a2b86-67b8-4678-be1b-e523ebb14b68-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Creating offline snapshot f3213ac4-e50a-4101-bebe-366996ff2a80 of volume 95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[96085151-34b5-46fb-b228-264ade265ba7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (278df9f0-e412-4c6c-8a42-c29b291bc44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bcad48-cee4-4ffe-91f0-0ec76c3954d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bcad48-cee4-4ffe-91f0-0ec76c3954d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621361068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:23Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a94ae54-af53-4513-abdc-b574c9765ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a94ae54-af53-4513-abdc-b574c9765ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9a878-fae7-491b-94df-a146dbc2861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9a878-fae7-491b-94df-a146dbc2861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63', 'volume_name': 'volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77735ed2-a94d-415b-9e03-76393f9853af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77735ed2-a94d-415b-9e03-76393f9853af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c542dd9c-33bc-4fb4-89e9-5d5ba794a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Volume 9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63', 'volume_size': 1} Aug 04 12:22:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:23 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 Aug 04 12:22:23 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:24 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" returned: 0 in 0.862s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:24 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 1G Aug 04 12:22:24 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-bcaac424-7f8f-4590-891b-c6b426a7eea5 tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:24 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 1G" returned: 0 in 0.875s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:24 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 Aug 04 12:22:24 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:25 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80" returned: 0 in 0.541s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:25 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 is being set with open permissions: ugo+rw Aug 04 12:22:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:25 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 Aug 04 12:22:25 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:25 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80" returned: 0 in 0.308s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:25 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info Aug 04 12:22:25 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:26 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info" returned: 0 in 0.300s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:26 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info is being set with open permissions: ugo+rw Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:26 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info Aug 04 12:22:26 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:26 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.info" returned: 0 in 0.388s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.430s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621361068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:23Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Creating volume 9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:26 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:26 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 1073741824 Aug 04 12:22:26 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-eee3f775-c280-488f-80e5-37578a873117 req-aa8c39f3-4b22-4b47-a52a-d73b0eda30e2 tempest-VolumesSnapshotsTestJSON-136513573 None] Create snapshot completed successfully Aug 04 12:22:27 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 1073741824" returned: 0 in 0.503s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "cinder-f3213ac4-e50a-4101-bebe-366996ff2a80-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-f3213ac4-e50a-4101-bebe-366996ff2a80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:27 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 Aug 04 12:22:27 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "cinder-quobyte-f3213ac4-e50a-4101-bebe-366996ff2a80" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-f3213ac4-e50a-4101-bebe-366996ff2a80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Deleting offline snapshot f3213ac4-e50a-4101-bebe-366996ff2a80 of volume 95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] snapshot_file for this snap is: volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec63424-a821-48aa-9d3e-74a00fb6591e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:27 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 Aug 04 12:22:27 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:27 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-bcaac424-7f8f-4590-891b-c6b426a7eea5 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.905s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c542dd9c-33bc-4fb4-89e9-5d5ba794a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551b75b2-84c4-4635-be71-e943080e4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-bcaac424-7f8f-4590-891b-c6b426a7eea5 tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Volume volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 (9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63): created successfully Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551b75b2-84c4-4635-be71-e943080e4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (278df9f0-e412-4c6c-8a42-c29b291bc44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e0184c19-18e3-43e1-8213-1c9e67b0682e tempest-AttachVolumeTestJSON-1709467866 None] Created volume successfully. Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-bcaac424-7f8f-4590-891b-c6b426a7eea5 tempest-ServerActionsTestOtherA-1773772153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-c1e84b4b-df9a-4888-8a29-c99067577bb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b38b5d3f-99e0-4ed6-bb38-5e58e9e2c857', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:22:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-7b94b01f-ae50-4c14-8619-9d379975cdf1 req-bcaac424-7f8f-4590-891b-c6b426a7eea5 tempest-ServerActionsTestOtherA-1773772153 None] attachment_update completed successfully. Aug 04 12:22:27 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80" returned: 0 in 0.477s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb543b-9ccd-466c-83eb-07c93bb3051d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:27 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 Aug 04 12:22:27 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:28 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" returned: 0 in 0.551s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:28 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 Aug 04 12:22:28 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:29 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80" returned: 0 in 0.707s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:29 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80 Aug 04 12:22:29 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:29 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2.f3213ac4-e50a-4101-bebe-366996ff2a80" returned: 0 in 0.456s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-f3213ac4-e50a-4101-bebe-366996ff2a80" released by "_delete_snapshot" :: held 2.358s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" released by "delete_snapshot" :: held 2.398s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:29 devstack cinder-volume[88895]: WARNING cinder.quota [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG cinder.quota [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Created reservations ['4dff99d5-c44d-48b8-b4c8-7ae4c1915180', '65eb715c-a619-41ea-9b4b-d97e4085aced', '118de4e0-cdf9-4531-9480-7be0dfea7e55', '2cead3f3-2b08-4a3a-9809-7d298cb3a4fd'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:22:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Delete snapshot completed successfully. Aug 04 12:22:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-bd05cdbe-1190-4fa0-8868-85045e010482 req-5540279d-3579-4af1-ad4c-89359a88092d tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-f3213ac4-e50a-4101-bebe-366996ff2a80-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-d3ec02df-189f-4a2c-8327-8569eede19c5 req-914d6c7f-ef92-4d66-86d9-d9826d44648a tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-d3ec02df-189f-4a2c-8327-8569eede19c5 req-914d6c7f-ef92-4d66-86d9-d9826d44648a tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-d3ec02df-189f-4a2c-8327-8569eede19c5 req-914d6c7f-ef92-4d66-86d9-d9826d44648a tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-d3ec02df-189f-4a2c-8327-8569eede19c5 req-914d6c7f-ef92-4d66-86d9-d9826d44648a tempest-AttachVolumeTestJSON-1709467866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81a2e602-bb47-4d00-b750-61431c865758', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:22:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-d3ec02df-189f-4a2c-8327-8569eede19c5 req-914d6c7f-ef92-4d66-86d9-d9826d44648a tempest-AttachVolumeTestJSON-1709467866 None] attachment_update completed successfully. Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "cinder-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66a24e-299a-4d47-98be-d540f0f13691]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:31 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 Aug 04 12:22:31 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:31 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" returned: 0 in 0.398s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:31 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2 Aug 04 12:22:31 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:31 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-quobyte-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2" released by "delete_volume" :: held 0.871s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG cinder.quota [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Created reservations ['32afc642-4841-4195-b078-a6f642892ba5', 'ad157fff-f2d1-4a3b-8d0f-0259e6a7a7d8', 'f35e6825-5a80-48e5-855d-8d0f4336fd24', '7697fd3b-055b-41ed-8360-a3910e48cc31'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:32 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:22:32 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:32 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.598s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG cinder.manager [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:22:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Deleted volume successfully. Aug 04 12:22:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-741beae6-7f3d-40e4-9f00-7df9b7254708 req-215aa920-03e3-4500-90c0-1f4ea02b0c11 tempest-VolumesSnapshotsTestJSON-136513573 None] Lock "cinder-95c9ce84-8821-4f7f-8c03-e1d6c07b6bb2-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:42 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=34,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:22:42 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=45,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:22:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83f51f83-4842-47a4-8207-13df00ac5420 tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-345764601: creating Aug 04 12:22:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83f51f83-4842-47a4-8207-13df00ac5420 tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-345764601: created successfully Aug 04 12:22:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83f51f83-4842-47a4-8207-13df00ac5420 tempest-GroupSnapshotsTest-688392268 None] Create group completed successfully. Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (e086c4e2-6597-4106-990b-37641e0e93da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1b83b2-af3e-4e2e-8574-f52784ed8b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1b83b2-af3e-4e2e-8574-f52784ed8b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959759776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2580b727-f3dc-441c-bfa1-49ba2b470a5b,host='devstack@QuobyteHD#QuobyteHD',id=ba670ea7-7379-48db-8fc4-8def9d0b7fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:46Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37b40d4d-42fb-4f1f-8d69-ec59e7209057),volume_type_id=37b40d4d-42fb-4f1f-8d69-ec59e7209057)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eeebe4-bd09-4cdd-a685-7ad50e5e7fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eeebe4-bd09-4cdd-a685-7ad50e5e7fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758677ea-6b85-4114-adbd-16479921917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758677ea-6b85-4114-adbd-16479921917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba670ea7-7379-48db-8fc4-8def9d0b7fee', 'volume_name': 'volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b8d62f-3fae-4d18-a570-5a679fa76307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b8d62f-3fae-4d18-a570-5a679fa76307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c13eb34-e85f-4d92-90f5-496552c16ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Volume ba670ea7-7379-48db-8fc4-8def9d0b7fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee', 'volume_size': 1} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2580b727-f3dc-441c-bfa1-49ba2b470a5b,created_at=2026-08-04T10:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959759776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2580b727-f3dc-441c-bfa1-49ba2b470a5b,host='devstack@QuobyteHD#QuobyteHD',id=ba670ea7-7379-48db-8fc4-8def9d0b7fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:46Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37b40d4d-42fb-4f1f-8d69-ec59e7209057),volume_type_id=37b40d4d-42fb-4f1f-8d69-ec59e7209057)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Creating volume ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:45 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee 1073741824 Aug 04 12:22:45 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:46 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee 1073741824" returned: 0 in 0.644s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:46 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:22:46 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (8832f028-9257-48b6-8f08-03a5de06ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59db7658-f9a0-4a7b-a72d-2c5c43825b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59db7658-f9a0-4a7b-a72d-2c5c43825b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-329721726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b39624-ab10-45e9-861a-235e2d24baa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:47Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e51f31a-3f9c-4c11-aaff-676d7991107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e51f31a-3f9c-4c11-aaff-676d7991107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996274d-3c7e-448a-a939-5e75a36d32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996274d-3c7e-448a-a939-5e75a36d32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b39624-ab10-45e9-861a-235e2d24baa3', 'volume_name': 'volume-b3b39624-ab10-45e9-861a-235e2d24baa3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e4b48d-16ee-498e-b195-331f8f42fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:46 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e4b48d-16ee-498e-b195-331f8f42fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c353ce1c-7202-401f-8645-9b8f6c6e688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Volume b3b39624-ab10-45e9-861a-235e2d24baa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b39624-ab10-45e9-861a-235e2d24baa3', 'volume_size': 1} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.413s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-329721726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b39624-ab10-45e9-861a-235e2d24baa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:47Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Creating volume b3b39624-ab10-45e9-861a-235e2d24baa3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:47 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c13eb34-e85f-4d92-90f5-496552c16ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdb2326-be23-4310-8819-4699b466c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:47 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 1073741824 Aug 04 12:22:47 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Volume volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee (ba670ea7-7379-48db-8fc4-8def9d0b7fee): created successfully Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdb2326-be23-4310-8819-4699b466c10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (e086c4e2-6597-4106-990b-37641e0e93da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:47 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b924eabc-35ff-4211-82f6-8d0ae8bf6719 tempest-GroupSnapshotsTest-688392268 None] Created volume successfully. Aug 04 12:22:47 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 1073741824" returned: 0 in 0.575s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:47 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 Aug 04 12:22:47 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:47 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c353ce1c-7202-401f-8645-9b8f6c6e688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b39624-ab10-45e9-861a-235e2d24baa3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad6875-be75-4e3e-94a7-b413472c66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Volume volume-b3b39624-ab10-45e9-861a-235e2d24baa3 (b3b39624-ab10-45e9-861a-235e2d24baa3): created successfully Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad6875-be75-4e3e-94a7-b413472c66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (8832f028-9257-48b6-8f08-03a5de06ec39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-eb692bca-3dfe-4c97-a9a6-0bf1b1f1ee95 tempest-VolumesTestJSON-306109710 None] Created volume successfully. Aug 04 12:22:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] GroupSnapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: creating. Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Group snapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: creating. {{(pid=88895) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Creating offline snapshot 543d80c5-fc97-4fd2-a23c-395ba1fcb132 of volume ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3ac8d-f31b-43a2-aba4-330358f2a7f2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:48 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:22:48 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:49 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:49 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 1G Aug 04 12:22:49 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:49 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (904d8f59-0471-4c8f-9567-de8828524cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b89ed-5e8b-45dd-82fb-f5281b7cd571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 1G" returned: 0 in 0.523s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:49 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:22:49 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b89ed-5e8b-45dd-82fb-f5281b7cd571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272772490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ce2a8d-7438-49f5-98fe-3bf3572a956b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:49Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cf93cb-ac9a-4df1-8c17-5c2ea078fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cf93cb-ac9a-4df1-8c17-5c2ea078fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daeab46-23e9-445b-b2aa-0afc06ee7259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daeab46-23e9-445b-b2aa-0afc06ee7259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ce2a8d-7438-49f5-98fe-3bf3572a956b', 'volume_name': 'volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee73835d-cbde-4a1e-a58f-36e2d96e3251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee73835d-cbde-4a1e-a58f-36e2d96e3251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a20488a-2b15-4bae-9a36-9787e741ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:49 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Volume 96ce2a8d-7438-49f5-98fe-3bf3572a956b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b', 'volume_size': 1} Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:49 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:49 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:22:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:49 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:22:49 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:50 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.229s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:50 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info Aug 04 12:22:50 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:50 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info" returned: 0 in 0.260s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:50 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:50 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info Aug 04 12:22:50 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:50 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.info" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272772490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ce2a8d-7438-49f5-98fe-3bf3572a956b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:49Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Creating volume 96ce2a8d-7438-49f5-98fe-3bf3572a956b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:50 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b 1073741824 Aug 04 12:22:50 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-75c0fe3d-d4bc-46a7-870a-624008fd8026 tempest-GroupSnapshotsTest-688392268 None] group_snapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: created successfully Aug 04 12:22:51 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b 1073741824" returned: 0 in 0.411s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:51 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b Aug 04 12:22:51 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:51 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b" returned: 0 in 0.242s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a20488a-2b15-4bae-9a36-9787e741ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a043c1a-55d5-481e-bab7-4602d75ee71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Volume volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b (96ce2a8d-7438-49f5-98fe-3bf3572a956b): created successfully Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a043c1a-55d5-481e-bab7-4602d75ee71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (904d8f59-0471-4c8f-9567-de8828524cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6267bca5-2428-403b-9e5f-a8b78643e90b tempest-VolumesTestJSON-306109710 None] Created volume successfully. Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (8db55467-a75d-4b74-917b-8321cbe22a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7acca-d2a0-43b3-9c0f-1c181eeffbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a7acca-d2a0-43b3-9c0f-1c181eeffbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-801234074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb528df-d91f-4880-a383-31d0ff7c719a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:52Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaae26d7-1158-4904-819f-0b7b48bac0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaae26d7-1158-4904-819f-0b7b48bac0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfa8d52-1b1c-4e97-ab36-2c7d6388b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfa8d52-1b1c-4e97-ab36-2c7d6388b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb528df-d91f-4880-a383-31d0ff7c719a', 'volume_name': 'volume-deb528df-d91f-4880-a383-31d0ff7c719a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f606860f-a46e-487b-ae27-9776ac4ac216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f606860f-a46e-487b-ae27-9776ac4ac216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe4b5f9-b954-427d-b49c-023f3e51fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Volume deb528df-d91f-4880-a383-31d0ff7c719a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb528df-d91f-4880-a383-31d0ff7c719a', 'volume_size': 1} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-801234074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb528df-d91f-4880-a383-31d0ff7c719a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d80e6d448e83471eb3dcd9121468ac52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:22:52Z,use_quota=True,user_id='642fc17d104f41049820da1d8a63c697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Creating volume deb528df-d91f-4880-a383-31d0ff7c719a {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:52 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:52 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a 1073741824 Aug 04 12:22:52 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:52 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a 1073741824" returned: 0 in 0.487s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:52 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a Aug 04 12:22:52 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:53 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a" returned: 0 in 0.265s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.487s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132-2554cb2b-d434-412b-8314-aaf3323702ba" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe4b5f9-b954-427d-b49c-023f3e51fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb528df-d91f-4880-a383-31d0ff7c719a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94964e28-f708-41ae-9c1e-41bea746b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132-2554cb2b-d434-412b-8314-aaf3323702ba" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Creating volume 2554cb2b-d434-412b-8314-aaf3323702ba from snapshot 543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Volume volume-deb528df-d91f-4880-a383-31d0ff7c719a (deb528df-d91f-4880-a383-31d0ff7c719a): created successfully Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94964e28-f708-41ae-9c1e-41bea746b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Flow 'volume_create_manager' (8db55467-a75d-4b74-917b-8321cbe22a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] snapshot: 543d80c5-fc97-4fd2-a23c-395ba1fcb132, volume: 2554cb2b-d434-412b-8314-aaf3323702ba, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:22:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-994ac892-2c7e-4886-ab31-64eba13ba493 tempest-VolumesTestJSON-306109710 None] Created volume successfully. Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4f5316-c1b7-4b2a-b80c-aa5d2cf57a51]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:53 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:22:53 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:53 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.385s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8da4c8-dbc1-4840-be32-e8bd463969a2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:53 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:22:53 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:54 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:22:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:22:54 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:22:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:54 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba Aug 04 12:22:54 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-deb528df-d91f-4880-a383-31d0ff7c719a-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "cinder-deb528df-d91f-4880-a383-31d0ff7c719a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-quobyte-deb528df-d91f-4880-a383-31d0ff7c719a" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-deb528df-d91f-4880-a383-31d0ff7c719a" acquired by "delete_volume" :: waited 0.052s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d62a6cc-9dca-4b22-b10e-437c0e462d43]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:22:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:56 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a Aug 04 12:22:56 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:58 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a" returned: 0 in 1.701s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:58 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a Aug 04 12:22:58 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:22:59 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-deb528df-d91f-4880-a383-31d0ff7c719a" returned: 0 in 1.068s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-deb528df-d91f-4880-a383-31d0ff7c719a" released by "delete_volume" :: held 2.909s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Created reservations ['440840f8-d980-4bc7-bc96-de739dd64643', '4a08f4c7-4428-4163-a9b9-c57133144dc3', '5eb02f3a-7cf3-4702-9c4c-9d9c600d61b0', '3c4d651f-fe2a-44ee-ac12-fc9b76987344'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:22:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:22:59 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:22:59 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-96ce2a8d-7438-49f5-98fe-3bf3572a956b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "cinder-96ce2a8d-7438-49f5-98fe-3bf3572a956b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-quobyte-96ce2a8d-7438-49f5-98fe-3bf3572a956b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-96ce2a8d-7438-49f5-98fe-3bf3572a956b" acquired by "delete_volume" :: waited 0.046s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[86512503-1ba5-4871-ba1d-fb1cc0ebaf95]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:00 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.834s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Deleted volume successfully. Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c4488a67-e978-4217-b59e-58148c556329 tempest-VolumesTestJSON-306109710 None] Lock "cinder-deb528df-d91f-4880-a383-31d0ff7c719a-delete_volume" released by "delete_volume" :: held 4.310s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:00 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b Aug 04 12:23:00 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:00 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba" returned: 0 in 6.755s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:23:00 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Converted 1024.00 MB image at 151.56 MB/s Aug 04 12:23:00 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:00 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba Aug 04 12:23:00 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:01 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b" returned: 0 in 0.564s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:01 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba" returned: 0 in 0.253s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" released by "_copy_volume_from_snapshot" :: held 7.849s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:01 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b Aug 04 12:23:01 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132-2554cb2b-d434-412b-8314-aaf3323702ba" released by "_create_volume_from_snapshot" :: held 7.937s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.972s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b7f13b82-e003-4976-8f17-de632294e6c5 tempest-GroupSnapshotsTest-688392268 None] Create group from source-snapshot-9bc46719-58b1-4f03-94ca-fbba1345a934 completed successfully. Aug 04 12:23:01 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96ce2a8d-7438-49f5-98fe-3bf3572a956b" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-96ce2a8d-7438-49f5-98fe-3bf3572a956b" released by "delete_volume" :: held 0.886s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Created reservations ['52fa24d3-4b0c-463a-a9a5-22709939eb3a', 'ef1bde50-a3ba-4fe7-a22f-0a8c1c0de4e0', '50a9c7ae-0860-4e2a-81c3-4ae75fdab870', 'fdf9a8a0-1655-426a-ae59-93ab8b3ae486'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:01 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:01 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:01 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.259s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Deleted volume successfully. Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d14e08e-3bbe-4620-9e6b-c7a550a51b71 tempest-VolumesTestJSON-306109710 None] Lock "cinder-96ce2a8d-7438-49f5-98fe-3bf3572a956b-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2d789-147c-4400-bc36-e4a0e9f6dafe]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:02 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba Aug 04 12:23:02 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:02 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba" returned: 0 in 0.411s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:02 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba Aug 04 12:23:02 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-b3b39624-ab10-45e9-861a-235e2d24baa3-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "cinder-b3b39624-ab10-45e9-861a-235e2d24baa3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Acquiring lock "cinder-quobyte-b3b39624-ab10-45e9-861a-235e2d24baa3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-b3b39624-ab10-45e9-861a-235e2d24baa3" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bd1d8-8a8f-4f4e-af55-fa3c90b5e582]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:02 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2554cb2b-d434-412b-8314-aaf3323702ba" returned: 0 in 0.295s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:02 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 Aug 04 12:23:02 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-2554cb2b-d434-412b-8314-aaf3323702ba" released by "delete_volume" :: held 0.769s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Created reservations ['cbcad985-646a-4ce8-a37a-35959a94751c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:02 devstack cinder-volume[88895]: WARNING cinder.quota [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1074302474 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1074302474, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:02 devstack cinder-volume[88895]: WARNING cinder.quota [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1074302474 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1074302474, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:02 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Created reservations ['4b000c14-9325-4e24-9434-e96cd8c7197d', 'b4ecbac1-776a-4f35-945c-a4b68b6a2a04', '28217a72-d56b-4fd9-b9ef-4e937024921b', 'aab3da94-4295-474a-8073-1607278f4144'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:03 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3" returned: 0 in 0.516s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:03 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:03 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:03 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3 Aug 04 12:23:03 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] group_snapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: deleting Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] group_snapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: deleting {{(pid=88895) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 04 12:23:03 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.434s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-95d5118a-f24d-4137-b6a0-f6b259e64d42 tempest-GroupSnapshotsTest-688392268 None] Delete group completed successfully. Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Deleting offline snapshot 543d80c5-fc97-4fd2-a23c-395ba1fcb132 of volume ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] snapshot_file for this snap is: volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b2b57c-9d14-46a7-b3af-bba1de8a1a25]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:03 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b3b39624-ab10-45e9-861a-235e2d24baa3" returned: 0 in 0.566s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "cinder-quobyte-b3b39624-ab10-45e9-861a-235e2d24baa3" released by "delete_volume" :: held 1.128s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Created reservations ['4b97f9d1-33b4-4c52-9fe8-a2297617bd30', 'af7fb3db-d869-4632-9033-bddeee878b82', 'cef42c39-c20f-4160-b105-2a881fd7b3e2', '576f9913-7ada-46f0-82a5-aebd15ebb09b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:03 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:23:03 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:03 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:03 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:04 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.280s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:04 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Deleted volume successfully. Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.480s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ec913-a9d7-4106-ab81-7413a21a914b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e939e6e4-ed45-42a8-baba-6a8c4c0ea768 tempest-VolumesTestJSON-306109710 None] Lock "cinder-b3b39624-ab10-45e9-861a-235e2d24baa3-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:04 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:23:04 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-4a146dfe-5bad-441d-8c83-d3677d6405e0 tempest-ServerActionsTestOtherA-1773772153 None] Terminate volume connection completed successfully. Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-4a146dfe-5bad-441d-8c83-d3677d6405e0 tempest-ServerActionsTestOtherA-1773772153 None] Deleting attachment b38b5d3f-99e0-4ed6-bb38-5e58e9e2c857. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "cinder-c1e84b4b-df9a-4888-8a29-c99067577bb7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-c1e84b4b-df9a-4888-8a29-c99067577bb7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "cinder-quobyte-c1e84b4b-df9a-4888-8a29-c99067577bb7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:04 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.616s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-quobyte-c1e84b4b-df9a-4888-8a29-c99067577bb7" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:04 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:23:04 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[06571cd6-b881-4689-8d64-6595e8f2813d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:05 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 Aug 04 12:23:05 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:05 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.473s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:05 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132 Aug 04 12:23:05 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:05 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7" returned: 0 in 0.592s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:05 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7 Aug 04 12:23:05 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:05 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee.543d80c5-fc97-4fd2-a23c-395ba1fcb132" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-543d80c5-fc97-4fd2-a23c-395ba1fcb132" released by "_delete_snapshot" :: held 2.085s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" released by "delete_snapshot" :: held 2.131s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:05 devstack cinder-volume[88895]: WARNING cinder.quota [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1074302474 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1074302474, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:05 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c1e84b4b-df9a-4888-8a29-c99067577bb7" returned: 0 in 0.315s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-quobyte-c1e84b4b-df9a-4888-8a29-c99067577bb7" released by "delete_volume" :: held 0.970s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] Created reservations ['dd09c35a-89ae-4a9e-9b0e-272d53a0d6f9', '7b749246-aaa0-4a4c-b7d1-977ce096fc2c', '31e3fa84-c291-478f-be6e-d7a6ee7f6487', 'f8a6af35-8a39-455d-9562-f91cf5ed26a1'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.quota [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Created reservations ['e0ba35a5-3530-44af-8139-f49a5f13a1a5', 'c0bfe1b4-acf1-4759-8379-6dcf2789773f', '3524de43-e6dd-4fce-ac49-7e05f8ec66e0', '4b469dda-8479-433f-8705-2f9110070e16'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c71957ad-7612-4cc7-bcb7-f255264e38bc tempest-GroupSnapshotsTest-688392268 None] group_snapshot 9bc46719-58b1-4f03-94ca-fbba1345a934: deleted successfully Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:05 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:05 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:06 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.376s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.manager [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Deleted volume successfully. Aug 04 12:23:06 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:06 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a259b551-7cf3-4adb-8501-d0fe2e4a18b4 req-f228ba4f-f4b4-4b3e-81a8-043eae84897f tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-c1e84b4b-df9a-4888-8a29-c99067577bb7-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "cinder-ff89599a-f401-4dbe-8c6a-ccd8894e98ef-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-ff89599a-f401-4dbe-8c6a-ccd8894e98ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "cinder-quobyte-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-quobyte-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388d074-c25b-4c09-88d8-0ec8456bad79]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:06 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:23:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:23:06 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef Aug 04 12:23:06 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:07 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" returned: 0 in 0.503s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:07 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef Aug 04 12:23:07 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cfe536-00ee-40a4-bcc4-810753f77a0f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:07 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:07 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:23:07 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" returned: 0 in 0.311s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-quobyte-ff89599a-f401-4dbe-8c6a-ccd8894e98ef" released by "delete_volume" :: held 0.879s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Created reservations ['f8e23081-ffd6-4004-be9b-ef91cc6b0610', '2c00233e-40c4-4257-b5aa-bb4428727b2f', '0e0f92b0-437b-496d-b3e3-ee2368846795', '04f23c02-d3ed-4169-91e1-c002768e3ac8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:07 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:07 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:07 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.436s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:07 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee Aug 04 12:23:07 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:07 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.329s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Deleted volume successfully. Aug 04 12:23:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f4b72921-a1a6-48a1-9d73-46189b2d670e tempest-ServerActionsTestOtherA-1773772153 None] Lock "cinder-ff89599a-f401-4dbe-8c6a-ccd8894e98ef-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:08 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ba670ea7-7379-48db-8fc4-8def9d0b7fee" returned: 0 in 0.362s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-ba670ea7-7379-48db-8fc4-8def9d0b7fee" released by "delete_volume" :: held 0.872s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Created reservations ['92b4ae76-0e0f-44ff-8d2b-0dca7fd45a26'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:08 devstack cinder-volume[88895]: WARNING cinder.db.api [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1074302474'] Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Created reservations ['9593968a-d836-45ca-8c5d-d8b8f3488530', '58b8760f-2679-4bc7-86e2-b306f076946e', '32ea79b1-e107-46ba-bf59-ead0edfa6ab5', 'ca336db0-c79c-461f-81c5-4abaa5d9f447'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:08 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:08 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:08 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.309s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-56d9df3e-b463-492c-81b1-2734a27a203f tempest-GroupSnapshotsTest-688392268 None] Delete group completed successfully. Aug 04 12:23:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2134961f-c4f4-4d8f-8171-d61c5136a9ed tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-877553583: creating Aug 04 12:23:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2134961f-c4f4-4d8f-8171-d61c5136a9ed tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-877553583: created successfully Aug 04 12:23:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2134961f-c4f4-4d8f-8171-d61c5136a9ed tempest-GroupSnapshotsTest-688392268 None] Create group completed successfully. Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (d23fe3db-4cbc-4665-bac5-61b09c621615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3fc99-7899-496c-8da5-beccf139a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3fc99-7899-496c-8da5-beccf139a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543192975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,host='devstack@QuobyteHD#QuobyteHD',id=cf515a43-786c-4f7c-a01a-fa426c499633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:12Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23aa6bad-39cb-4459-b745-d76fd583cd6d),volume_type_id=23aa6bad-39cb-4459-b745-d76fd583cd6d)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dbcdd8-4f48-47a1-b1ec-498aea547151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dbcdd8-4f48-47a1-b1ec-498aea547151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e04cfd-aefc-4aa0-b505-c78e17dbc4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e04cfd-aefc-4aa0-b505-c78e17dbc4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf515a43-786c-4f7c-a01a-fa426c499633', 'volume_name': 'volume-cf515a43-786c-4f7c-a01a-fa426c499633', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb22b13-5492-432b-b928-d07c94e97ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb22b13-5492-432b-b928-d07c94e97ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d313f9-7273-4b0d-aa8a-237f68215a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:11 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Volume cf515a43-786c-4f7c-a01a-fa426c499633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf515a43-786c-4f7c-a01a-fa426c499633', 'volume_size': 1} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,created_at=2026-08-04T10:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543192975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,host='devstack@QuobyteHD#QuobyteHD',id=cf515a43-786c-4f7c-a01a-fa426c499633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:12Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23aa6bad-39cb-4459-b745-d76fd583cd6d),volume_type_id=23aa6bad-39cb-4459-b745-d76fd583cd6d)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Creating volume cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:11 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:11 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 1073741824 Aug 04 12:23:12 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:12 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 1073741824" returned: 0 in 0.515s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:12 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 Aug 04 12:23:12 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:12 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633" returned: 0 in 0.258s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d313f9-7273-4b0d-aa8a-237f68215a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf515a43-786c-4f7c-a01a-fa426c499633', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1467cdf4-42ba-4050-97cf-517bc9ac7c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:12 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Volume volume-cf515a43-786c-4f7c-a01a-fa426c499633 (cf515a43-786c-4f7c-a01a-fa426c499633): created successfully Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1467cdf4-42ba-4050-97cf-517bc9ac7c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (d23fe3db-4cbc-4665-bac5-61b09c621615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d1c8aa9d-d6bd-458f-a0d7-9a2aede6fc58 tempest-GroupSnapshotsTest-688392268 None] Created volume successfully. Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (73aa34ef-f902-4d99-ac4b-c16ced71ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e10623d-4c85-4ee9-83ce-3d454e802985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e10623d-4c85-4ee9-83ce-3d454e802985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-111107369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,host='devstack@QuobyteHD#QuobyteHD',id=1f8cd247-ca77-4060-8ea9-6e9f4f78723b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:14Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23aa6bad-39cb-4459-b745-d76fd583cd6d),volume_type_id=23aa6bad-39cb-4459-b745-d76fd583cd6d)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a6dc9-2c7e-4234-8de0-d1b1b6f2f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a6dc9-2c7e-4234-8de0-d1b1b6f2f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e076e4-40d0-465c-a2bf-617f5bedd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e076e4-40d0-465c-a2bf-617f5bedd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8cd247-ca77-4060-8ea9-6e9f4f78723b', 'volume_name': 'volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6d6e5-e3b7-4cef-8967-8b16c13de669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6d6e5-e3b7-4cef-8967-8b16c13de669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19abf62-7c53-4839-8370-010dcd1155b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:13 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Volume 1f8cd247-ca77-4060-8ea9-6e9f4f78723b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b', 'volume_size': 1} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,created_at=2026-08-04T10:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-111107369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=435c1f59-fe6b-4570-bf51-7cf075018ee2,host='devstack@QuobyteHD#QuobyteHD',id=1f8cd247-ca77-4060-8ea9-6e9f4f78723b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:14Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23aa6bad-39cb-4459-b745-d76fd583cd6d),volume_type_id=23aa6bad-39cb-4459-b745-d76fd583cd6d)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Creating volume 1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:13 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:13 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b 1073741824 Aug 04 12:23:13 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cce2e849-aca4-4061-a6c1-e2804fe15340 tempest-GroupsTest-595944793 None] Group tempest-Group1-1097294941: creating Aug 04 12:23:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cce2e849-aca4-4061-a6c1-e2804fe15340 tempest-GroupsTest-595944793 None] Group tempest-Group1-1097294941: created successfully Aug 04 12:23:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cce2e849-aca4-4061-a6c1-e2804fe15340 tempest-GroupsTest-595944793 None] Create group completed successfully. Aug 04 12:23:14 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b 1073741824" returned: 0 in 0.502s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:14 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b Aug 04 12:23:14 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:14 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19abf62-7c53-4839-8370-010dcd1155b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3b664a-ff8a-46a9-a878-a66929060ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:14 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Volume volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b (1f8cd247-ca77-4060-8ea9-6e9f4f78723b): created successfully Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3b664a-ff8a-46a9-a878-a66929060ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (73aa34ef-f902-4d99-ac4b-c16ced71ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3f73336a-52b2-43b1-99c3-f76ee669ed4c tempest-GroupSnapshotsTest-688392268 None] Created volume successfully. Aug 04 12:23:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-54f28019-70e6-4a98-aaf5-0e3d493f8e10 tempest-GroupSnapshotsTest-688392268 None] Update group completed successfully. Aug 04 12:23:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6f30ea72-1129-4a7b-989e-ce07dcbee461 tempest-GroupsTest-595944793 None] Group tempest-Group2-660069591: creating Aug 04 12:23:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6f30ea72-1129-4a7b-989e-ce07dcbee461 tempest-GroupsTest-595944793 None] Group tempest-Group2-660069591: created successfully Aug 04 12:23:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6f30ea72-1129-4a7b-989e-ce07dcbee461 tempest-GroupsTest-595944793 None] Create group completed successfully. Aug 04 12:23:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b9148d7-f572-4598-8622-7760f3392e61 tempest-GroupSnapshotsTest-688392268 None] Update group completed successfully. Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (f1dc42cb-3538-4621-b08a-acea36411fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3268def1-40bc-404b-bbb9-cef72abcd4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3268def1-40bc-404b-bbb9-cef72abcd4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1879097454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d603dbb-bab5-4395-b515-7dffcea587b9,host='devstack@QuobyteHD#QuobyteHD',id=87431610-114f-461a-a01d-031fca645014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:17Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba8957b1-7353-4449-842f-c7671f79ad47),volume_type_id=ba8957b1-7353-4449-842f-c7671f79ad47)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e0e59d-029a-412e-974a-20960f0a6d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e0e59d-029a-412e-974a-20960f0a6d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78464b26-a396-4950-8f19-83c90459dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78464b26-a396-4950-8f19-83c90459dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87431610-114f-461a-a01d-031fca645014', 'volume_name': 'volume-87431610-114f-461a-a01d-031fca645014', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519ba114-ee3d-4402-8342-2712777be5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519ba114-ee3d-4402-8342-2712777be5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f998a0-8473-40d9-8229-4fa0ccea583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Volume 87431610-114f-461a-a01d-031fca645014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87431610-114f-461a-a01d-031fca645014', 'volume_size': 1} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d603dbb-bab5-4395-b515-7dffcea587b9,created_at=2026-08-04T10:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1879097454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d603dbb-bab5-4395-b515-7dffcea587b9,host='devstack@QuobyteHD#QuobyteHD',id=87431610-114f-461a-a01d-031fca645014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:17Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba8957b1-7353-4449-842f-c7671f79ad47),volume_type_id=ba8957b1-7353-4449-842f-c7671f79ad47)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Creating volume 87431610-114f-461a-a01d-031fca645014 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:16 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:16 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 1073741824 Aug 04 12:23:16 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:17 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 1073741824" returned: 0 in 0.474s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:17 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 Aug 04 12:23:17 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d71ff83e-915d-46f5-873a-3468cbb6fb64 tempest-GroupSnapshotsTest-688392268 None] Update group completed successfully. Aug 04 12:23:17 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f998a0-8473-40d9-8229-4fa0ccea583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87431610-114f-461a-a01d-031fca645014', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887d4288-cdc4-4946-917c-e2a9d5efdbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Volume volume-87431610-114f-461a-a01d-031fca645014 (87431610-114f-461a-a01d-031fca645014): created successfully Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887d4288-cdc4-4946-917c-e2a9d5efdbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (f1dc42cb-3538-4621-b08a-acea36411fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b438cbc2-2f81-4553-bead-03993aee8e57 tempest-GroupsTest-595944793 None] Created volume successfully. Aug 04 12:23:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Acquiring lock "cinder-quobyte-87431610-114f-461a-a01d-031fca645014" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-87431610-114f-461a-a01d-031fca645014" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:18 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee600b35-db3c-494a-b2db-6980adb46bdf]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f3a35616-452e-4b67-8c0c-7cad91c1e1a5 tempest-GroupSnapshotsTest-688392268 None] Update group completed successfully. Aug 04 12:23:18 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 Aug 04 12:23:18 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:19 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:19 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014 Aug 04 12:23:19 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:19 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-87431610-114f-461a-a01d-031fca645014" returned: 0 in 0.269s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-87431610-114f-461a-a01d-031fca645014" released by "delete_volume" :: held 0.741s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Created reservations ['eda9b9f4-6d10-4567-b607-6e4129217493'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:19 devstack cinder-volume[88895]: WARNING cinder.quota [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1310942133 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1310942133, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:19 devstack cinder-volume[88895]: WARNING cinder.quota [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1310942133 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1310942133, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Created reservations ['29935ed2-8654-435f-9f4f-9cce10080c0a', 'b1afd86a-75d6-492d-bb3f-7345af490942', 'f8201857-0cc7-4c1a-864c-74236bd7fbf7', 'c3bdc35c-d3b8-4966-b2ae-f73c34e3415f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:19 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:19 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:19 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:19 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-21225590-4d03-4f81-a692-e47c7c4489ed tempest-GroupsTest-595944793 None] Delete group completed successfully. Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Created reservations ['985a8111-bd15-4bfd-a8fd-28171290572d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:20 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:20 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:20 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b87a263d-6906-4aba-937c-848397b1407c tempest-GroupsTest-595944793 None] Delete group completed successfully. Aug 04 12:23:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] GroupSnapshot ea0909ce-82b6-4401-af43-f19195781940: creating. Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Group snapshot ea0909ce-82b6-4401-af43-f19195781940: creating. {{(pid=88895) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Creating offline snapshot 5b2d49c5-23ee-4844-a942-6a76913f3523 of volume 1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[319db88b-e06a-4ce5-b184-e5ee54b36baa]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:20 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b Aug 04 12:23:20 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:20 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" returned: 0 in 0.365s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:20 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 1G Aug 04 12:23:20 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:21 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 1G" returned: 0 in 0.512s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:21 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 Aug 04 12:23:21 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3ee8d51a-581f-4427-b377-b2928d3862ec tempest-GroupsTest-595944793 None] Group tempest-GroupsTest-Group-333133877: creating Aug 04 12:23:21 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523" returned: 0 in 0.442s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:21 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3ee8d51a-581f-4427-b377-b2928d3862ec tempest-GroupsTest-595944793 None] Group tempest-GroupsTest-Group-333133877: created successfully Aug 04 12:23:21 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 Aug 04 12:23:21 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3ee8d51a-581f-4427-b377-b2928d3862ec tempest-GroupsTest-595944793 None] Create group completed successfully. Aug 04 12:23:22 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:22 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info Aug 04 12:23:22 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-5d35f790-e2d0-4ea8-8326-e47ddc5ba147 req-3217dd16-a11d-42e8-bece-c84ff52f3051 tempest-AttachVolumeTestJSON-1709467866 None] Terminate volume connection completed successfully. Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-5d35f790-e2d0-4ea8-8326-e47ddc5ba147 req-3217dd16-a11d-42e8-bece-c84ff52f3051 tempest-AttachVolumeTestJSON-1709467866 None] Deleting attachment 81a2e602-bb47-4d00-b750-61431c865758. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:22 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:22 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:22 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info Aug 04 12:23:22 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:22 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.info" returned: 0 in 0.268s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Creating offline snapshot 67b30901-e548-4fb4-8342-68d319bf9f11 of volume cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc27d5-035f-4c39-ae9f-f2236808caaa]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:23 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 Aug 04 12:23:23 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:23 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633" returned: 0 in 0.498s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:23 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 1G Aug 04 12:23:23 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (faff491f-8649-413d-9f34-a79b8838a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f854ff73-215a-4ed2-9928-07aa35ad6fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f854ff73-215a-4ed2-9928-07aa35ad6fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091311420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,host='devstack@QuobyteHD#QuobyteHD',id=16903aa2-840a-412b-b035-1a94a93a5e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:24Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ecbec7-7607-4b7f-94b1-c0b56399b236),volume_type_id=70ecbec7-7607-4b7f-94b1-c0b56399b236)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1ef66b-1c78-4b7f-9a19-9ab84c77d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1ef66b-1c78-4b7f-9a19-9ab84c77d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cdc277-b03c-4494-a3c5-636ddf247e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cdc277-b03c-4494-a3c5-636ddf247e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16903aa2-840a-412b-b035-1a94a93a5e73', 'volume_name': 'volume-16903aa2-840a-412b-b035-1a94a93a5e73', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a785e-5822-436a-ad92-5d29420eb81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a785e-5822-436a-ad92-5d29420eb81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744e411b-3707-4bad-8655-1a2f52f84360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Volume 16903aa2-840a-412b-b035-1a94a93a5e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16903aa2-840a-412b-b035-1a94a93a5e73', 'volume_size': 1} Aug 04 12:23:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:24 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 1G" returned: 0 in 0.667s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf515a43-786c-4f7c-a01a-fa426c499633 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:24 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf515a43-786c-4f7c-a01a-fa426c499633 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 Aug 04 12:23:24 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:24 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf515a43-786c-4f7c-a01a-fa426c499633 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11" returned: 0 in 0.370s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:24 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:24 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 Aug 04 12:23:24 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:24 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:24 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info Aug 04 12:23:24 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:25 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info" returned: 0 in 0.299s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:25 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:25 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info Aug 04 12:23:25 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:25 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.info" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,created_at=2026-08-04T10:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091311420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,host='devstack@QuobyteHD#QuobyteHD',id=16903aa2-840a-412b-b035-1a94a93a5e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:24Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ecbec7-7607-4b7f-94b1-c0b56399b236),volume_type_id=70ecbec7-7607-4b7f-94b1-c0b56399b236)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Creating volume 16903aa2-840a-412b-b035-1a94a93a5e73 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:25 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:25 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 1073741824 Aug 04 12:23:25 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3579791d-0add-4e5c-94b7-7363a3c0d1f4 tempest-GroupSnapshotsTest-688392268 None] group_snapshot ea0909ce-82b6-4401-af43-f19195781940: created successfully Aug 04 12:23:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] group_snapshot ea0909ce-82b6-4401-af43-f19195781940: deleting Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] group_snapshot ea0909ce-82b6-4401-af43-f19195781940: deleting {{(pid=88895) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-5b2d49c5-23ee-4844-a942-6a76913f3523" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:26 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 1073741824" returned: 0 in 0.723s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-5b2d49c5-23ee-4844-a942-6a76913f3523" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Deleting offline snapshot 5b2d49c5-23ee-4844-a942-6a76913f3523 of volume 1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] snapshot_file for this snap is: volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c2b31-c849-43b0-abc1-8681d4723de7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:26 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 Aug 04 12:23:26 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:26 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 Aug 04 12:23:26 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:26 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73" returned: 0 in 0.370s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744e411b-3707-4bad-8655-1a2f52f84360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16903aa2-840a-412b-b035-1a94a93a5e73', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d638b0d3-6239-4e91-946e-ee71ad2916df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Volume volume-16903aa2-840a-412b-b035-1a94a93a5e73 (16903aa2-840a-412b-b035-1a94a93a5e73): created successfully Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d638b0d3-6239-4e91-946e-ee71ad2916df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (faff491f-8649-413d-9f34-a79b8838a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b8fc353d-1312-4920-b17f-3bf006d2e549 tempest-GroupsTest-595944793 None] Created volume successfully. Aug 04 12:23:26 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523" returned: 0 in 0.519s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[08344df6-e5eb-43e9-ad26-b7a78993e68f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:27 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b Aug 04 12:23:27 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:27 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" returned: 0 in 0.614s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:27 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 Aug 04 12:23:27 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:28 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523" returned: 0 in 0.638s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:28 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523 Aug 04 12:23:28 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:28 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b.5b2d49c5-23ee-4844-a942-6a76913f3523" returned: 0 in 0.478s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-5b2d49c5-23ee-4844-a942-6a76913f3523" released by "_delete_snapshot" :: held 2.449s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" released by "delete_snapshot" :: held 2.517s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (d379b7a7-e907-44ab-99b7-0fa4472d8a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8bd45d-015a-4a40-a9ad-e16cef8d09e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8bd45d-015a-4a40-a9ad-e16cef8d09e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1354789746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,host='devstack@QuobyteHD#QuobyteHD',id=f52b4894-6ff3-49d5-8be6-b76ff35323d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:29Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ecbec7-7607-4b7f-94b1-c0b56399b236),volume_type_id=70ecbec7-7607-4b7f-94b1-c0b56399b236)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeffc0d-2669-46ca-b050-44123c5cbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeffc0d-2669-46ca-b050-44123c5cbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1a1223-9818-423a-85f0-e57936f4b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1a1223-9818-423a-85f0-e57936f4b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52b4894-6ff3-49d5-8be6-b76ff35323d5', 'volume_name': 'volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f74675b-2924-4df3-af16-a7973ab5b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f74675b-2924-4df3-af16-a7973ab5b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905f18fc-7826-4d0a-a4b0-927e4c6b269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Volume f52b4894-6ff3-49d5-8be6-b76ff35323d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5', 'volume_size': 1} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,created_at=2026-08-04T10:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1354789746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f990a4-81eb-4d3c-8608-cdda14bbd39d,host='devstack@QuobyteHD#QuobyteHD',id=f52b4894-6ff3-49d5-8be6-b76ff35323d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b60e3d97454016bfe660e4fa02bfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:29Z,use_quota=True,user_id='33ecb40953f74140a365a86525af390e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ecbec7-7607-4b7f-94b1-c0b56399b236),volume_type_id=70ecbec7-7607-4b7f-94b1-c0b56399b236)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Creating volume f52b4894-6ff3-49d5-8be6-b76ff35323d5 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:28 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" acquired by "delete_snapshot" :: waited 0.102s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-67b30901-e548-4fb4-8342-68d319bf9f11" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:28 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 1073741824 Aug 04 12:23:28 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-67b30901-e548-4fb4-8342-68d319bf9f11" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Deleting offline snapshot 67b30901-e548-4fb4-8342-68d319bf9f11 of volume cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] snapshot_file for this snap is: volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4cf49a-c40f-4053-b6c8-9363db51099c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:29 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 Aug 04 12:23:29 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:29 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11" returned: 0 in 0.660s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf515a43-786c-4f7c-a01a-fa426c499633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:29 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 1073741824" returned: 0 in 0.795s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e94c1-c361-434e-9fd6-59eef67ef541]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:29 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 Aug 04 12:23:29 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:29 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 Aug 04 12:23:29 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:30 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905f18fc-7826-4d0a-a4b0-927e4c6b269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435f71b0-a592-418b-8937-09241cd5683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:30 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Volume volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 (f52b4894-6ff3-49d5-8be6-b76ff35323d5): created successfully Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435f71b0-a592-418b-8937-09241cd5683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Flow 'volume_create_manager' (d379b7a7-e907-44ab-99b7-0fa4472d8a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-342625b1-169c-42f2-be54-dfdb152fe0ee tempest-GroupsTest-595944793 None] Created volume successfully. Aug 04 12:23:30 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633" returned: 0 in 0.674s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:30 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 Aug 04 12:23:30 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:30 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11" returned: 0 in 0.531s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:30 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11 Aug 04 12:23:30 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:31 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633.67b30901-e548-4fb4-8342-68d319bf9f11" returned: 0 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-67b30901-e548-4fb4-8342-68d319bf9f11" released by "_delete_snapshot" :: held 2.420s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" released by "delete_snapshot" :: held 2.449s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:31 devstack cinder-volume[88895]: WARNING cinder.quota [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1905567349 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1905567349, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:31 devstack cinder-volume[88895]: WARNING cinder.quota [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1905567349 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1905567349, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:31 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Created reservations ['37e89b77-64a8-4de5-b90c-33abc59232f6', '4e7d9d62-715b-46d0-a026-9edeeed74864', 'a6c08f2d-e488-466d-8c39-a3ce730f0ffc', 'cae988eb-ee17-422c-b9ed-c6b35f2faabd'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d27be739-32b9-4690-89fc-b08499d57b7d tempest-GroupsTest-595944793 None] Update group completed successfully. Aug 04 12:23:31 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] Created reservations ['7f0f399c-526b-48a9-a332-bdd3cefc2136', 'd29a0d1d-adaa-4bb7-8a95-ca21f94c8839', 'a9551d45-6fac-4bf6-bb6d-dd3d32ae4f0a', 'b6a7950c-f7ce-47f1-a634-d908c3a2652b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c43661ac-17d7-4300-a8e8-e22d950d562a tempest-GroupSnapshotsTest-688392268 None] group_snapshot ea0909ce-82b6-4401-af43-f19195781940: deleted successfully Aug 04 12:23:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f42acf-58e0-46ae-8cc7-afe1ea77b646]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:32 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b Aug 04 12:23:32 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:33 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" returned: 0 in 0.600s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:33 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b Aug 04 12:23:33 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1641d761-65c8-4b49-8c34-b74c8dc682be tempest-GroupsTest-595944793 None] Update group completed successfully. Aug 04 12:23:33 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-1f8cd247-ca77-4060-8ea9-6e9f4f78723b" released by "delete_volume" :: held 1.027s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aef8369-e6f8-4299-bb85-33fe6e4a1c5a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:33 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 Aug 04 12:23:33 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:34 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633" returned: 0 in 0.556s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:34 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633 Aug 04 12:23:34 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:34 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf515a43-786c-4f7c-a01a-fa426c499633" returned: 0 in 0.267s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-cf515a43-786c-4f7c-a01a-fa426c499633" released by "delete_volume" :: held 0.903s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Created reservations ['fa29ff2e-e6fc-4ed5-bebc-fee64e71ca5c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:34 devstack cinder-volume[88895]: WARNING cinder.quota [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1905567349 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1905567349, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Created reservations ['248ceb59-3a3f-46d6-b455-566e01705c8b', 'e844136e-5e6d-47f4-b293-4d3d420085d2', '8ede2e0b-1ed9-405f-9653-331af5fe2113', '38a11233-5da0-4646-b9d4-18420f0bfa49'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Created reservations ['5c0d6639-2d6a-4d88-aab8-f0d9be390149', '2dfd293d-2ba3-403e-9e9f-067c313a8027', '4753feb3-66e2-400d-a71f-6c4a10ace69c', '18a3d53b-4505-48cf-ba6b-9b6c984f11b1'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:34 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:34 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Acquiring lock "cinder-quobyte-16903aa2-840a-412b-b035-1a94a93a5e73" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-16903aa2-840a-412b-b035-1a94a93a5e73" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c42fd-ec18-410e-856b-8183141099dd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:35 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.313s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7e24b876-11e2-4bb9-9948-29b42c1b527d tempest-GroupSnapshotsTest-688392268 None] Delete group completed successfully. Aug 04 12:23:35 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 Aug 04 12:23:35 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:35 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73" returned: 0 in 0.508s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:35 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73 Aug 04 12:23:35 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-db7aa718-5fc7-4caf-878b-03ac53b2ccb4 tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-1733517598: creating Aug 04 12:23:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-db7aa718-5fc7-4caf-878b-03ac53b2ccb4 tempest-GroupSnapshotsTest-688392268 None] Group tempest-GroupSnapshotsTest-Group-1733517598: created successfully Aug 04 12:23:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-db7aa718-5fc7-4caf-878b-03ac53b2ccb4 tempest-GroupSnapshotsTest-688392268 None] Create group completed successfully. Aug 04 12:23:35 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16903aa2-840a-412b-b035-1a94a93a5e73" returned: 0 in 0.290s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-16903aa2-840a-412b-b035-1a94a93a5e73" released by "delete_volume" :: held 0.887s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Acquiring lock "cinder-quobyte-f52b4894-6ff3-49d5-8be6-b76ff35323d5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-f52b4894-6ff3-49d5-8be6-b76ff35323d5" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d6e3d-fba0-4c86-851e-5554a47a0036]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:36 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 Aug 04 12:23:36 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:36 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5" returned: 0 in 0.463s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:36 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5 Aug 04 12:23:36 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:36 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f52b4894-6ff3-49d5-8be6-b76ff35323d5" returned: 0 in 0.350s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "cinder-quobyte-f52b4894-6ff3-49d5-8be6-b76ff35323d5" released by "delete_volume" :: held 0.870s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Created reservations ['f98e7718-889e-4e2b-8cd6-772fac3bdb39'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:36 devstack cinder-volume[88895]: WARNING cinder.quota [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1882355231 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1882355231, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:36 devstack cinder-volume[88895]: WARNING cinder.quota [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1882355231 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1882355231, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:36 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Created reservations ['a6b75121-2bad-49a4-b51d-ec218625f40c', '3976eab7-a64f-4600-8fc3-afa688bcf4f0', 'cc053d53-df7e-499d-b747-08fa052cb855', '5821b020-0a9d-44b7-8dea-6c37a740ada9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Created reservations ['5b415b82-71f6-4d95-b430-b3127d780ba9', 'c87a2911-2412-4cd7-a360-041a88a8f393', '9cd31218-641f-40a9-a738-e57699373e2f', '53b9cf3f-96be-4ffa-85ae-07a3215a52b7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:37 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:37 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (e3d52c7f-96ab-4c3b-84e7-5376eec178f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df1a279-0e42-491e-9061-30356e3bee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df1a279-0e42-491e-9061-30356e3bee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696587572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afd78259-29dc-491e-a63d-a54332711abd,host='devstack@QuobyteHD#QuobyteHD',id=90d0d799-c78a-4b53-a49f-d9b8764f9ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:37Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624d7265-0b2e-4180-bdfb-3325d7c695f1),volume_type_id=624d7265-0b2e-4180-bdfb-3325d7c695f1)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776527fe-f2d3-473e-a0d3-bc5c900d1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776527fe-f2d3-473e-a0d3-bc5c900d1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bade1a-110d-41a1-97fa-1e69e9dad49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bade1a-110d-41a1-97fa-1e69e9dad49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d0d799-c78a-4b53-a49f-d9b8764f9ff0', 'volume_name': 'volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45d4ec-479f-46b3-b115-9dfb1a2f31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac45d4ec-479f-46b3-b115-9dfb1a2f31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc682398-113c-425d-8e98-37670583cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Volume 90d0d799-c78a-4b53-a49f-d9b8764f9ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0', 'volume_size': 1} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=afd78259-29dc-491e-a63d-a54332711abd,created_at=2026-08-04T10:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696587572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afd78259-29dc-491e-a63d-a54332711abd,host='devstack@QuobyteHD#QuobyteHD',id=90d0d799-c78a-4b53-a49f-d9b8764f9ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85eb5a79d44eadb97826a4383799f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:37Z,use_quota=True,user_id='aa7b49cae8a34330b654cff0405d830d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(624d7265-0b2e-4180-bdfb-3325d7c695f1),volume_type_id=624d7265-0b2e-4180-bdfb-3325d7c695f1)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Creating volume 90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:37 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:37 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 1073741824 Aug 04 12:23:37 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:38 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.683s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:38 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9e8d3ecf-2fe3-4f50-8dde-61041695aa97 tempest-GroupsTest-595944793 None] Delete group completed successfully. Aug 04 12:23:38 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 1073741824" returned: 0 in 0.702s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:38 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 Aug 04 12:23:38 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:39 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" returned: 0 in 0.521s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc682398-113c-425d-8e98-37670583cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319e72c-e79b-48a7-baed-ad8601173767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Volume volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 (90d0d799-c78a-4b53-a49f-d9b8764f9ff0): created successfully Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319e72c-e79b-48a7-baed-ad8601173767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Flow 'volume_create_manager' (e3d52c7f-96ab-4c3b-84e7-5376eec178f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b82cf029-c505-4b8e-99a4-7286999b42d3 tempest-GroupSnapshotsTest-688392268 None] Created volume successfully. Aug 04 12:23:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] GroupSnapshot 76976bb1-cf56-48fd-939f-405647f96782: creating. Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Group snapshot 76976bb1-cf56-48fd-939f-405647f96782: creating. {{(pid=88895) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Creating offline snapshot c27ef31c-718f-4a8f-bc60-ea0e0af45f03 of volume 90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c78079-0c43-4af9-9eab-6d483a52e05c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:41 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 Aug 04 12:23:41 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:41 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" returned: 0 in 0.825s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:41 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 1G Aug 04 12:23:41 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:42 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 1G" returned: 0 in 0.997s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:42 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 Aug 04 12:23:42 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:43 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03" returned: 0 in 0.588s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:43 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:43 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 Aug 04 12:23:43 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:43 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03" returned: 0 in 0.328s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=164,cinder:UPDATE=172,cinder:INSERT=43,cinder:DELETE=8 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=166,cinder:UPDATE=188,cinder:DELETE=7,cinder:INSERT=37 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:43 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info Aug 04 12:23:43 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:43 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:43 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:23:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:44 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info Aug 04 12:23:44 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:44 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.info" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:44 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c3181509-ed9a-4957-b19d-e7087a746d57 tempest-GroupSnapshotsTest-688392268 None] group_snapshot 76976bb1-cf56-48fd-939f-405647f96782: created successfully Aug 04 12:23:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] group_snapshot 76976bb1-cf56-48fd-939f-405647f96782: deleting Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] group_snapshot 76976bb1-cf56-48fd-939f-405647f96782: deleting {{(pid=88895) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-c27ef31c-718f-4a8f-bc60-ea0e0af45f03" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-c27ef31c-718f-4a8f-bc60-ea0e0af45f03" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Deleting offline snapshot c27ef31c-718f-4a8f-bc60-ea0e0af45f03 of volume 90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] snapshot_file for this snap is: volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9123ac-e5dd-46d4-b662-daffb1592504]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:23:45 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 Aug 04 12:23:45 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Flow 'volume_create_manager' (807be3ff-f267-4b02-81ba-cd843db9adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928d1847-adeb-4e8b-8194-63676e032ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928d1847-adeb-4e8b-8194-63676e032ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1151980053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d7e475-9493-4ce7-93db-fee7d4d0aca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dfbda7e33e448fac7bfbe637b408cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:46Z,use_quota=True,user_id='3151f435b5bf43bbbc1516b601ad4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6562a149-c840-4538-89e9-8a793bd47eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6562a149-c840-4538-89e9-8a793bd47eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e50701-4193-4048-b3ac-9916d0646021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e50701-4193-4048-b3ac-9916d0646021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d7e475-9493-4ce7-93db-fee7d4d0aca4', 'volume_name': 'volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b9403c-5889-4add-90f7-46a762a53b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b9403c-5889-4add-90f7-46a762a53b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42859f6f-a2ee-4f25-9216-46f60142140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4', 'volume_size': 1} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1151980053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d7e475-9493-4ce7-93db-fee7d4d0aca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dfbda7e33e448fac7bfbe637b408cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:23:46Z,use_quota=True,user_id='3151f435b5bf43bbbc1516b601ad4b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Creating volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:23:46 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:46 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 1073741824 Aug 04 12:23:46 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:46 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03" returned: 0 in 0.660s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42e6c3-f1e5-42d2-820a-70a42d93e3b1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:46 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 Aug 04 12:23:46 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:46 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 1073741824" returned: 0 in 0.761s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:46 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 Aug 04 12:23:46 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:47 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:47 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 Aug 04 12:23:47 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:47 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4" returned: 0 in 0.328s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42859f6f-a2ee-4f25-9216-46f60142140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23489c17-9fd3-4cc4-b7f0-99379dcc4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:23:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Volume volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 (69d7e475-9493-4ce7-93db-fee7d4d0aca4): created successfully Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23489c17-9fd3-4cc4-b7f0-99379dcc4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Flow 'volume_create_manager' (807be3ff-f267-4b02-81ba-cd843db9adfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:23:47 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f5b262b1-f3fb-4b7d-888e-48115140baed tempest-SnapshotsActionsTest-564725997 None] Created volume successfully. Aug 04 12:23:47 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03" returned: 0 in 0.510s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:47 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03 Aug 04 12:23:47 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:47 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0.c27ef31c-718f-4a8f-bc60-ea0e0af45f03" returned: 0 in 0.293s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-c27ef31c-718f-4a8f-bc60-ea0e0af45f03" released by "_delete_snapshot" :: held 2.261s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" released by "delete_snapshot" :: held 2.326s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:48 devstack cinder-volume[88895]: WARNING cinder.quota [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1624608629 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1624608629, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:48 devstack cinder-volume[88895]: WARNING cinder.quota [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1624608629 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1624608629, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] Created reservations ['eaed8390-e6ca-4039-a3e3-9e783071b652', '431720d9-3d32-45bd-a528-a80aa106657a', '93627bf4-afef-4eeb-b5ca-7e88d8179b3a', 'e17433ce-fa82-425e-946e-92796db81133'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a4afb74d-b027-44d6-ac14-b4fcd038f4b7 tempest-GroupSnapshotsTest-688392268 None] group_snapshot 76976bb1-cf56-48fd-939f-405647f96782: deleted successfully Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Creating offline snapshot 56874fb4-8d03-4fca-bc72-734c9b232069 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727de8e-b65e-478d-8366-69bcaa6ff111]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:48 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 Aug 04 12:23:48 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:49 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4" returned: 0 in 0.599s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:49 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 1G Aug 04 12:23:49 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" acquired by "delete_volume" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc405094-7a9e-4be9-ade3-d6bdc9613a74]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:50 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 1G" returned: 0 in 0.990s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:50 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 Aug 04 12:23:50 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:50 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:23:50 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:50 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" returned: 0 in 0.534s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:50 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0 Aug 04 12:23:50 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:50 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.504s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:50 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 is being set with open permissions: ugo+rw Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:50 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:23:50 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:50 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" returned: 0 in 0.418s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Lock "cinder-quobyte-90d0d799-c78a-4b53-a49f-d9b8764f9ff0" released by "delete_volume" :: held 1.069s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:23:51 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Created reservations ['2fd5a15a-758c-47bb-bd91-79e1a9fcb593'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:51 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info Aug 04 12:23:51 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:51 devstack cinder-volume[88895]: WARNING cinder.quota [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1624608629 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1624608629, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Created reservations ['9c82694f-b711-4fd1-bdc6-781653fa47df', '2ce0a428-aefc-4928-8144-01601bb615ee', '522ab1e2-719c-400a-8094-a816b42b230c', 'e912cfd2-9311-4256-92a7-d731fe04ff59'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:51 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:23:51 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:51 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info" returned: 0 in 0.652s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:51 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info is being set with open permissions: ugo+rw Aug 04 12:23:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:51 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info Aug 04 12:23:51 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:52 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.623s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:52 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:23:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-62ab6e31-d19a-4bad-b581-2412f26ca7cc tempest-GroupSnapshotsTest-688392268 None] Delete group completed successfully. Aug 04 12:23:52 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.info" returned: 0 in 0.685s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.998s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-430ec7ff-8d0a-4edc-959f-06d277e97863 tempest-SnapshotsActionsTest-564725997 None] Create snapshot completed successfully Aug 04 12:23:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:23:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:23:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Creating offline snapshot 0b870e33-3308-4a00-b84a-b69a9aeacf67 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:23:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c243bb-6896-4170-b1f4-19c4957da53b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:54 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:23:54 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:55 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 1.014s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:55 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 1G Aug 04 12:23:55 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:56 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 1G" returned: 0 in 1.140s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:56 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 Aug 04 12:23:56 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:56 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:56 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 is being set with open permissions: ugo+rw Aug 04 12:23:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:56 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 Aug 04 12:23:56 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:57 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67" returned: 0 in 0.475s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:23:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a8cf7397-fbd8-481d-b5e0-7d0d184aca4c tempest-SnapshotsActionsTest-564725997 None] Create snapshot completed successfully Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-0b870e33-3308-4a00-b84a-b69a9aeacf67-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-0b870e33-3308-4a00-b84a-b69a9aeacf67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-0b870e33-3308-4a00-b84a-b69a9aeacf67" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-0b870e33-3308-4a00-b84a-b69a9aeacf67" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Deleting offline snapshot 0b870e33-3308-4a00-b84a-b69a9aeacf67 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] snapshot_file for this snap is: volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac371c51-eb2d-4258-a925-bbad307f6982]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:58 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 Aug 04 12:23:58 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:23:59 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Aug 04 12:23:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67" returned: 0 in 0.717s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:23:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:23:59 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[11033068-f551-44ea-ac9a-3b4e5abb91eb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:23:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:23:59 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:23:59 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:00 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.620s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:00 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 Aug 04 12:24:00 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:00 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67" returned: 0 in 0.582s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:00 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67 Aug 04 12:24:00 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:01 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0b870e33-3308-4a00-b84a-b69a9aeacf67" returned: 0 in 0.316s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-0b870e33-3308-4a00-b84a-b69a9aeacf67" released by "_delete_snapshot" :: held 2.448s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_snapshot" :: held 2.500s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Created reservations ['158a741e-7ca4-409f-9312-914852ecafdd', 'ce90fff1-3848-4083-8eaf-ec1cf7cb04ea', 'b0a88977-5771-4713-a47e-f2b1de39eb9f', 'd976f08c-73d9-42b9-99b2-1136973c82df'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Delete snapshot completed successfully. Aug 04 12:24:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33bf1401-598a-48cc-95bb-f13db6bf0773 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-0b870e33-3308-4a00-b84a-b69a9aeacf67-delete_snapshot" released by "delete_snapshot" :: held 2.843s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Creating offline snapshot 0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb3f30-d46e-4e2c-b03e-3cfdce4b704a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:02 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:02 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b3db7377-2d9a-4315-aa54-6f5ef58b29af tempest-GroupSnapshotsV319Test-190967098 None] Group tempest-GroupSnapshotsV319Test-Group-126743278: creating Aug 04 12:24:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b3db7377-2d9a-4315-aa54-6f5ef58b29af tempest-GroupSnapshotsV319Test-190967098 None] Group tempest-GroupSnapshotsV319Test-Group-126743278: created successfully Aug 04 12:24:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b3db7377-2d9a-4315-aa54-6f5ef58b29af tempest-GroupSnapshotsV319Test-190967098 None] Create group completed successfully. Aug 04 12:24:02 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:02 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 1G Aug 04 12:24:02 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:03 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 1G" returned: 0 in 0.488s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:03 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 Aug 04 12:24:03 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Flow 'volume_create_manager' (d92cf1f0-a2d1-4e50-8298-ce7909e91213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546ead91-339b-44cd-b3d8-c161b08c9e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546ead91-339b-44cd-b3d8-c161b08c9e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-254718654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaafc882-e187-4cb3-b5e5-c2e2f98d35fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534914d9808484d9b903935a19ac2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:03Z,use_quota=True,user_id='0397c7d0bc574b1c9cd2c8ddca55c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca39a748-fe19-47fe-9571-b7c3307f76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca39a748-fe19-47fe-9571-b7c3307f76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb6e4b2-c111-4289-811e-231055c76f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb6e4b2-c111-4289-811e-231055c76f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaafc882-e187-4cb3-b5e5-c2e2f98d35fe', 'volume_name': 'volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409b634-f7e8-48b3-99bd-e39fac9711b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3409b634-f7e8-48b3-99bd-e39fac9711b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac74f96-f630-4a8b-9df3-9877630f942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:03 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Volume eaafc882-e187-4cb3-b5e5-c2e2f98d35fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe', 'volume_size': 1} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:03 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:03 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 is being set with open permissions: ugo+rw Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:03 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 Aug 04 12:24:03 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:03 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" returned: 0 in 0.257s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.747s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-254718654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaafc882-e187-4cb3-b5e5-c2e2f98d35fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534914d9808484d9b903935a19ac2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:03Z,use_quota=True,user_id='0397c7d0bc574b1c9cd2c8ddca55c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Creating volume eaafc882-e187-4cb3-b5e5-c2e2f98d35fe {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:03 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:03 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe 1073741824 Aug 04 12:24:03 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-91a3b0fb-34e4-4a99-9f4c-2c971f2d6cda tempest-SnapshotsActionsTest-564725997 None] Create snapshot completed successfully Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Flow 'volume_create_manager' (7b8d69d9-77eb-49fb-ab84-3905e58a64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74c407f-c6ec-4e1f-bba7-0c136abc58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74c407f-c6ec-4e1f-bba7-0c136abc58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789644102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7e0ae13-b81b-443a-af8e-ea32ca5889a3,host='devstack@QuobyteHD#QuobyteHD',id=b7d4517e-f240-45d7-82e6-fb9fa15dd3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464c131a743742dd8e5f8fb339737c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:04Z,use_quota=True,user_id='124c04c801034e049607fbd44d879ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1672a72-69bd-4f11-88ce-daf7659282b4),volume_type_id=c1672a72-69bd-4f11-88ce-daf7659282b4)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c26f85a-a969-49e1-b234-33d40ee62cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c26f85a-a969-49e1-b234-33d40ee62cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ddc300-4d7f-42b3-a8aa-4ac9b1803f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ddc300-4d7f-42b3-a8aa-4ac9b1803f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d4517e-f240-45d7-82e6-fb9fa15dd3a3', 'volume_name': 'volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c61c0c7-8da2-4e5a-829e-1262feef9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c61c0c7-8da2-4e5a-829e-1262feef9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccf7d69-3dff-405d-9411-882ecb857b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Volume b7d4517e-f240-45d7-82e6-fb9fa15dd3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3', 'volume_size': 1} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Deleting offline snapshot 0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:04 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] snapshot_file for this snap is: volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe 1073741824" returned: 0 in 0.730s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[facff2bf-f350-4add-a21d-2cb864be410e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:04 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe Aug 04 12:24:04 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:04 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 Aug 04 12:24:04 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:05 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7e0ae13-b81b-443a-af8e-ea32ca5889a3,created_at=2026-08-04T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789644102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7e0ae13-b81b-443a-af8e-ea32ca5889a3,host='devstack@QuobyteHD#QuobyteHD',id=b7d4517e-f240-45d7-82e6-fb9fa15dd3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464c131a743742dd8e5f8fb339737c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:04Z,use_quota=True,user_id='124c04c801034e049607fbd44d879ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1672a72-69bd-4f11-88ce-daf7659282b4),volume_type_id=c1672a72-69bd-4f11-88ce-daf7659282b4)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Creating volume b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:05 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac74f96-f630-4a8b-9df3-9877630f942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d30edd-553d-4ca0-a917-635c35ba86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:05 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 1073741824 Aug 04 12:24:05 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Volume volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe (eaafc882-e187-4cb3-b5e5-c2e2f98d35fe): created successfully Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d30edd-553d-4ca0-a917-635c35ba86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Flow 'volume_create_manager' (d92cf1f0-a2d1-4e50-8298-ce7909e91213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-210466b0-d164-4c76-b7a2-f2ebf96cf3e9 tempest-ServersNegativeTestJSON-668807045 None] Created volume successfully. Aug 04 12:24:05 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" returned: 0 in 0.629s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bf345-42f7-4f18-8d9a-8243043f04cb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:05 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:05 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:06 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.614s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:06 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 Aug 04 12:24:06 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:06 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 1073741824" returned: 0 in 1.097s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:06 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 Aug 04 12:24:06 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:06 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:06 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:06 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" returned: 0 in 0.783s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:06 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.600s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:06 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:24:06 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5 Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:24:06 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" returned: 0 in 0.685s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccf7d69-3dff-405d-9411-882ecb857b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2954cd3-5d9f-46e9-b171-83222e78bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Volume volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 (b7d4517e-f240-45d7-82e6-fb9fa15dd3a3): created successfully Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2954cd3-5d9f-46e9-b171-83222e78bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Flow 'volume_create_manager' (7b8d69d9-77eb-49fb-ab84-3905e58a64b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0543d7a0-e14f-4ed5-a9a3-41b113fdd471 tempest-GroupSnapshotsV319Test-190967098 None] Created volume successfully. Aug 04 12:24:07 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" returned: 0 in 0.395s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5" released by "_delete_snapshot" :: held 2.618s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_snapshot" :: held 2.653s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Created reservations ['f1fd764c-9450-43de-9e60-ce294832be5a', 'b4c0ca99-4e48-46f3-a2fa-b7e34b19f881', '6ff18038-3f05-4323-a894-d9a4b98e8303', 'ce7369de-549e-4c14-9f58-5af1f7dd7477'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Delete snapshot completed successfully. Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-20140c9f-ef5e-4d55-af4e-50e3619b65cb tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-0c2cfbaa-7caa-4a2c-82f5-d2f48bd409b5-delete_snapshot" released by "delete_snapshot" :: held 2.828s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Flow 'volume_create_manager' (a2612c2d-3b8a-4079-b992-9d56d35fd98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f196f09-f7c0-44a7-9035-c560f5ac3a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f196f09-f7c0-44a7-9035-c560f5ac3a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993897287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415ee9cb-43b3-4453-94e3-1a90572501c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534914d9808484d9b903935a19ac2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:08Z,use_quota=True,user_id='0397c7d0bc574b1c9cd2c8ddca55c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c604cb-d125-43cc-9fe7-f7bea37dfa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c604cb-d125-43cc-9fe7-f7bea37dfa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c76d5-3120-4542-bee3-3b1263682fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c76d5-3120-4542-bee3-3b1263682fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415ee9cb-43b3-4453-94e3-1a90572501c2', 'volume_name': 'volume-415ee9cb-43b3-4453-94e3-1a90572501c2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7b9da6-1363-4e64-ad25-3af147d21cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7b9da6-1363-4e64-ad25-3af147d21cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f0ae45-af7d-4afa-b0d8-1bf9d63cab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:07 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Volume 415ee9cb-43b3-4453-94e3-1a90572501c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415ee9cb-43b3-4453-94e3-1a90572501c2', 'volume_size': 1} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993897287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415ee9cb-43b3-4453-94e3-1a90572501c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534914d9808484d9b903935a19ac2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:08Z,use_quota=True,user_id='0397c7d0bc574b1c9cd2c8ddca55c190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Creating volume 415ee9cb-43b3-4453-94e3-1a90572501c2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:07 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:07 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 1073741824 Aug 04 12:24:07 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] GroupSnapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: creating. Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Group snapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: creating. {{(pid=88895) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:08 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 1073741824" returned: 0 in 0.606s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:08 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 Aug 04 12:24:08 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:08 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.600s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Creating offline snapshot 25961c78-703b-4d61-926a-e2fdc6815ceb of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f0ae45-af7d-4afa-b0d8-1bf9d63cab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415ee9cb-43b3-4453-94e3-1a90572501c2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b685b6b-87ea-4418-870a-83191f401a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453a4df-8f77-4c13-b1d6-b9a10d4004de]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:09 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Volume volume-415ee9cb-43b3-4453-94e3-1a90572501c2 (415ee9cb-43b3-4453-94e3-1a90572501c2): created successfully Aug 04 12:24:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b685b6b-87ea-4418-870a-83191f401a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Flow 'volume_create_manager' (a2612c2d-3b8a-4079-b992-9d56d35fd98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ee4d5605-f259-4def-9bb5-228958b1e6ad tempest-ServersNegativeTestJSON-668807045 None] Created volume successfully. Aug 04 12:24:09 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:09 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:09 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.480s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:09 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb 1G Aug 04 12:24:09 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:10 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb 1G" returned: 0 in 0.857s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:10 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb Aug 04 12:24:10 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "cinder-415ee9cb-43b3-4453-94e3-1a90572501c2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-415ee9cb-43b3-4453-94e3-1a90572501c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "cinder-quobyte-415ee9cb-43b3-4453-94e3-1a90572501c2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-quobyte-415ee9cb-43b3-4453-94e3-1a90572501c2" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e99bd3-ab9b-4d60-bd67-a09d4513a389]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:10 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 Aug 04 12:24:10 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:10 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb" returned: 0 in 0.393s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:10 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb is being set with open permissions: ugo+rw Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:10 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb Aug 04 12:24:10 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:10 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2" returned: 0 in 0.412s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:10 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb" returned: 0 in 0.280s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:11 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2 Aug 04 12:24:11 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.639s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Creating offline snapshot eb2f29d4-3473-44b9-ba85-6c42bb950afc of volume b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:24:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-82249394-2d1b-4545-ac04-cd6d2b21e877 tempest-SnapshotsActionsTest-564725997 None] Create snapshot completed successfully Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b469854-a434-4e07-9d3f-705f9c0aa869]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:11 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 Aug 04 12:24:11 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:11 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-415ee9cb-43b3-4453-94e3-1a90572501c2" returned: 0 in 0.419s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-quobyte-415ee9cb-43b3-4453-94e3-1a90572501c2" released by "delete_volume" :: held 0.918s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Created reservations ['07c89b58-2ae1-4533-bcb7-7d3fab77c65e', 'cf6cb552-2a6f-445a-bcd6-63c002208dbe', 'eaa2f744-6323-456e-9ea2-30c95df9744d', '1d453e09-9b57-4c1c-bb79-ec12a0b689e3'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:11 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-25961c78-703b-4d61-926a-e2fdc6815ceb-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" returned: 0 in 0.668s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:11 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:11 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:11 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc 1G Aug 04 12:24:11 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-25961c78-703b-4d61-926a-e2fdc6815ceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-25961c78-703b-4d61-926a-e2fdc6815ceb" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-25961c78-703b-4d61-926a-e2fdc6815ceb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Deleting offline snapshot 25961c78-703b-4d61-926a-e2fdc6815ceb of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] snapshot_file for this snap is: volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade7dcca-fd8e-4c18-b99a-98b6f16ba65d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:12 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb Aug 04 12:24:12 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:12 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.439s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Deleted volume successfully. Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dfae2f45-367e-4a41-8edc-c0842f9f733c tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-415ee9cb-43b3-4453-94e3-1a90572501c2-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:12 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc 1G" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:12 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc Aug 04 12:24:12 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:12 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb" returned: 0 in 0.615s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[28204966-4ce7-4054-ae8b-032f1f982523]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:12 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:12 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:12 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:12 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "cinder-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:12 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc Aug 04 12:24:12 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "cinder-quobyte-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-quobyte-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d2b934-4221-4436-b95b-e258dfd6dfa2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:13 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.643s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:13 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc" returned: 0 in 0.437s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:13 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb Aug 04 12:24:13 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:13 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info Aug 04 12:24:13 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:13 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe Aug 04 12:24:13 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:13 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info" returned: 0 in 0.508s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:13 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:13 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info Aug 04 12:24:13 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:13 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" returned: 0 in 0.794s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:14 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb" returned: 0 in 0.705s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:14 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe Aug 04 12:24:14 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:14 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb Aug 04 12:24:14 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:14 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.info" returned: 0 in 0.401s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:14 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-quobyte-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe" released by "delete_volume" :: held 1.210s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f2ad71f2-e541-496a-ad23-f0a3ce576e7e tempest-GroupSnapshotsV319Test-190967098 None] group_snapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: created successfully Aug 04 12:24:14 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Created reservations ['63f3acea-f5be-4738-8542-bf0e4baecbd0', '4be43a48-258e-48c9-8afd-be0feb0687b0', '4433cdbd-54a3-4f8a-b147-9dff01d46c43', 'd8630b8c-59fc-4a47-aaee-18dd0cfc4c1f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.25961c78-703b-4d61-926a-e2fdc6815ceb" returned: 0 in 0.445s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-25961c78-703b-4d61-926a-e2fdc6815ceb" released by "_delete_snapshot" :: held 2.587s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_snapshot" :: held 2.646s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Created reservations ['04e6e137-f14c-4429-a911-d13f1e53ea55', '278e31e2-16dd-49cd-a41f-7a97ce6a7a13', 'c4735733-23ed-4a6b-b134-b205aa7df0e1', '5a88d448-87da-4eaf-b242-882149d07ed8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:14 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:14 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Delete snapshot completed successfully. Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec4386b7-79bf-4ee4-bd80-fa57ceda02f9 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-25961c78-703b-4d61-926a-e2fdc6815ceb-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:14 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.361s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Deleted volume successfully. Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-639839b4-bade-4c7c-ac5a-a10798e609af tempest-ServersNegativeTestJSON-668807045 None] Lock "cinder-eaafc882-e187-4cb3-b5e5-c2e2f98d35fe-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] group_snapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: deleting Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] group_snapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: deleting {{(pid=88895) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "cinder-quobyte-eb2f29d4-3473-44b9-ba85-6c42bb950afc" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-eb2f29d4-3473-44b9-ba85-6c42bb950afc" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Deleting offline snapshot eb2f29d4-3473-44b9-ba85-6c42bb950afc of volume b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] snapshot_file for this snap is: volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6f8c5-3e70-4ba2-af5f-2edcd84deed5]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Creating offline snapshot c53498b1-669a-464f-8fe3-5d86484013c4 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:24:15 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc Aug 04 12:24:15 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a3565-87fa-4ee0-a8ba-7cbac06aa768]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:16 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:16 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:16 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc" returned: 0 in 0.550s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd6538-609f-4e6e-a6d1-5a9e44293d36]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:16 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 Aug 04 12:24:16 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:16 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.769s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:16 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 1G Aug 04 12:24:16 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:16 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" returned: 0 in 0.643s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:16 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc Aug 04 12:24:16 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:17 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 1G" returned: 0 in 0.729s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:17 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc" returned: 0 in 0.551s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:17 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 Aug 04 12:24:17 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:17 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc Aug 04 12:24:17 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:18 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3.eb2f29d4-3473-44b9-ba85-6c42bb950afc" returned: 0 in 0.541s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:18 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4" returned: 0 in 0.620s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:18 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 is being set with open permissions: ugo+rw Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-eb2f29d4-3473-44b9-ba85-6c42bb950afc" released by "_delete_snapshot" :: held 2.542s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" released by "delete_snapshot" :: held 2.609s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:18 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 Aug 04 12:24:18 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:18 devstack cinder-volume[88895]: WARNING cinder.quota [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1815249565 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1815249565, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:24:18 devstack cinder-volume[88895]: WARNING cinder.quota [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1815249565 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1815249565, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] Created reservations ['24a2e35a-99a9-44e3-9340-67b5a7d8d63a', 'faacae94-f8cd-4d18-a3d4-5750a5c41eb4', '4bf9eb82-4877-4f6a-b6e7-82288d684e77', '3168d5bd-3477-405d-90a6-7d1bbabf65ac'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3c693d93-1d54-4fa4-94cb-88b87bc7a6b3 tempest-GroupSnapshotsV319Test-190967098 None] group_snapshot efa7b28c-c0a5-4f2f-83fa-57e18bb009ed: deleted successfully Aug 04 12:24:18 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4" returned: 0 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-11ba094c-85b9-4185-833a-a5ad2f3aba91 tempest-SnapshotsActionsTest-564725997 None] Create snapshot completed successfully Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-c53498b1-669a-464f-8fe3-5d86484013c4-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-c53498b1-669a-464f-8fe3-5d86484013c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Acquiring lock "cinder-quobyte-c53498b1-669a-464f-8fe3-5d86484013c4" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-c53498b1-669a-464f-8fe3-5d86484013c4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Deleting offline snapshot c53498b1-669a-464f-8fe3-5d86484013c4 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] snapshot_file for this snap is: volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[261dad18-8de6-4263-9603-be6d6fae8853]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:19 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 Aug 04 12:24:19 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" acquired by "delete_volume" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db1ae5-cb2c-40a3-b559-7acfa39e35ba]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:19 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 Aug 04 12:24:19 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:19 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4" returned: 0 in 0.611s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a461c-fc7c-4f7a-b1c3-c94f9d0778d4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:19 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:19 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:20 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" returned: 0 in 0.513s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:20 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3 Aug 04 12:24:20 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:20 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.508s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:20 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 Aug 04 12:24:20 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:20 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" returned: 0 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Lock "cinder-quobyte-b7d4517e-f240-45d7-82e6-fb9fa15dd3a3" released by "delete_volume" :: held 0.972s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Created reservations ['f84ec610-7005-455b-a32a-316bb63d44b6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:20 devstack cinder-volume[88895]: WARNING cinder.quota [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1815249565 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1815249565, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Created reservations ['9b8d6bd3-b9ba-4ad3-a4fa-b356a90570b9', 'd9e66309-85e7-448a-aed5-57f76727096f', 'b8a18fbf-d6cb-4b6d-a851-44b45d7c6eed', '2b2b06b9-6a7d-4ad3-8f92-d006a15504a6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:20 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4" returned: 0 in 0.542s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:20 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:20 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:20 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4 Aug 04 12:24:20 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:21 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.377s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:21 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f59f4a2c-6ea8-485f-b68a-7ef17925ad5c tempest-GroupSnapshotsV319Test-190967098 None] Delete group completed successfully. Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.c53498b1-669a-464f-8fe3-5d86484013c4" returned: 0 in 0.370s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-c53498b1-669a-464f-8fe3-5d86484013c4" released by "_delete_snapshot" :: held 2.159s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_snapshot" :: held 2.190s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Created reservations ['909a690b-616c-431f-b36c-cf5d71447c1e', '3be04dcb-348b-4a65-8940-ae58ad7688b8', 'f1f50d6e-6288-4edd-a87a-852d0cb94fe0', '9244836a-5947-4b7d-b035-3a823b2dfb0f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Delete snapshot completed successfully. Aug 04 12:24:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1b5ef6c6-256a-49cc-adbd-0ccda993cbb1 tempest-SnapshotsActionsTest-2078548206 None] Lock "cinder-c53498b1-669a-464f-8fe3-5d86484013c4-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "cinder-56874fb4-8d03-4fca-bc72-734c9b232069-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-56874fb4-8d03-4fca-bc72-734c9b232069-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "cinder-quobyte-56874fb4-8d03-4fca-bc72-734c9b232069" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-56874fb4-8d03-4fca-bc72-734c9b232069" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Deleting offline snapshot 56874fb4-8d03-4fca-bc72-734c9b232069 of volume 69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] snapshot_file for this snap is: volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[969978d5-341f-4dcd-bcb5-820661e3ebc9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:23 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:23 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:23 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.501s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:23 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57b3af-f612-466c-b674-f9fd324ba682]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:23 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 Aug 04 12:24:23 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:24 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4" returned: 0 in 0.581s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:24 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:24 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:24 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:24 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069 Aug 04 12:24:24 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:24 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4.56874fb4-8d03-4fca-bc72-734c9b232069" returned: 0 in 0.309s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-56874fb4-8d03-4fca-bc72-734c9b232069" released by "_delete_snapshot" :: held 2.060s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_snapshot" :: held 2.087s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:25 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Created reservations ['d94b9ff4-42c1-4ecf-b84c-a47d7de1975f', '92d68ba9-34f3-45a8-9cdd-bf54a69c068f', '64eb84b0-6e26-4695-bde9-87dc440592b8', '02d750ae-6b83-4964-9d71-33fa662ab3ef'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Delete snapshot completed successfully. Aug 04 12:24:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a8a7091-1bc2-409a-9a29-430c94ae6a86 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-56874fb4-8d03-4fca-bc72-734c9b232069-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "cinder-69d7e475-9493-4ce7-93db-fee7d4d0aca4-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-69d7e475-9493-4ce7-93db-fee7d4d0aca4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[78130939-092d-4348-88e1-f9e6d1c9b5a0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:26 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 Aug 04 12:24:26 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:26 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4" returned: 0 in 0.413s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:26 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4 Aug 04 12:24:26 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:27 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69d7e475-9493-4ce7-93db-fee7d4d0aca4" returned: 0 in 0.286s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-quobyte-69d7e475-9493-4ce7-93db-fee7d4d0aca4" released by "delete_volume" :: held 0.803s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Created reservations ['84a04dd0-2f23-4710-9a7b-6535d329f014', '38e441cd-0a08-4b1c-a53f-7d0782a9295c', '5017ef65-a844-4eeb-8cc6-c87c29221e7e', '7a7a592c-0efc-4ece-a3f8-21c1b3fa9d79'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:27 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:27 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Flow 'volume_create_manager' (e6597164-d1c1-4133-9bd3-13cd5bd5f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b5863-8922-4d78-acf5-46dd21709c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b5863-8922-4d78-acf5-46dd21709c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-231994599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd25a21b-736a-4f04-b2ce-82344d3299b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c65baa8e734a37aedce182c2ff7fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:27Z,use_quota=True,user_id='177513160ffe4160a5a9f2003807310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61befe3-4ff2-4a62-98ca-05352c5af1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61befe3-4ff2-4a62-98ca-05352c5af1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18120083-0c4c-4b6d-b08c-46d516a3f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18120083-0c4c-4b6d-b08c-46d516a3f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd25a21b-736a-4f04-b2ce-82344d3299b9', 'volume_name': 'volume-bd25a21b-736a-4f04-b2ce-82344d3299b9', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0977944-c8f9-4f3e-927d-68dc693138aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0977944-c8f9-4f3e-927d-68dc693138aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daebad09-2c1a-4949-a481-2d49fd8ff41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Volume bd25a21b-736a-4f04-b2ce-82344d3299b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd25a21b-736a-4f04-b2ce-82344d3299b9', 'volume_size': 1} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-231994599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd25a21b-736a-4f04-b2ce-82344d3299b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75c65baa8e734a37aedce182c2ff7fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:27Z,use_quota=True,user_id='177513160ffe4160a5a9f2003807310c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Creating volume bd25a21b-736a-4f04-b2ce-82344d3299b9 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:27 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:27 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 1073741824 Aug 04 12:24:27 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:27 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.319s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Deleted volume successfully. Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a5940f95-227f-48c2-9c1d-51fa3d2d3080 tempest-SnapshotsActionsTest-564725997 None] Lock "cinder-69d7e475-9493-4ce7-93db-fee7d4d0aca4-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:27 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 1073741824" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:28 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 Aug 04 12:24:28 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:28 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9" returned: 0 in 0.303s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daebad09-2c1a-4949-a481-2d49fd8ff41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd25a21b-736a-4f04-b2ce-82344d3299b9', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8f6db7-3bcb-4b11-8bf5-8f1c886d6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Volume volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 (bd25a21b-736a-4f04-b2ce-82344d3299b9): created successfully Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8f6db7-3bcb-4b11-8bf5-8f1c886d6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Flow 'volume_create_manager' (e6597164-d1c1-4133-9bd3-13cd5bd5f053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:28 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-a99ab888-f6f2-423e-aa55-6ba3d4be8c42 req-dcff4168-1020-4ef7-a66b-90c7a66da88e tempest-VolumesGetTestJSON-813822698 None] Created volume successfully. Aug 04 12:24:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Acquiring lock "cinder-bd25a21b-736a-4f04-b2ce-82344d3299b9-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "cinder-bd25a21b-736a-4f04-b2ce-82344d3299b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Acquiring lock "cinder-quobyte-bd25a21b-736a-4f04-b2ce-82344d3299b9" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "cinder-quobyte-bd25a21b-736a-4f04-b2ce-82344d3299b9" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbbe50-9a5e-41df-94a4-179d306bb8f2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:30 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 Aug 04 12:24:30 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:30 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9" returned: 0 in 0.533s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:30 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9 Aug 04 12:24:30 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:30 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bd25a21b-736a-4f04-b2ce-82344d3299b9" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "cinder-quobyte-bd25a21b-736a-4f04-b2ce-82344d3299b9" released by "delete_volume" :: held 0.957s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG cinder.quota [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Created reservations ['1acf71a4-4f28-44f4-b805-88076fe4672a', '6c07d0d1-a476-4294-be5e-ecf807a7f164', '0e11ef93-0568-4cd1-81e5-d900372a35dc', '1c766f54-e42b-40f7-8b83-269f475e3cc7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:31 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:31 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:31 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG cinder.manager [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Deleted volume successfully. Aug 04 12:24:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-a19e8bca-e5c2-41d7-9ff4-05d7683e4afe req-a3d30ace-d06a-4dd5-a5aa-b71a0a3fa281 tempest-VolumesGetTestJSON-813822698 None] Lock "cinder-bd25a21b-736a-4f04-b2ce-82344d3299b9-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-38697472-6e05-434e-9814-c4ca806d2972 tempest-GroupsV314Test-1927025508 None] Group tempest-GroupsV314Test-Group-1903677570: creating Aug 04 12:24:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-38697472-6e05-434e-9814-c4ca806d2972 tempest-GroupsV314Test-1927025508 None] Group tempest-GroupsV314Test-Group-1903677570: created successfully Aug 04 12:24:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-38697472-6e05-434e-9814-c4ca806d2972 tempest-GroupsV314Test-1927025508 None] Create group completed successfully. Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (03f4893c-8e8c-4030-a6a1-68332d936500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ac95ea-953b-48a3-8ccc-99b1a3df0b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ac95ea-953b-48a3-8ccc-99b1a3df0b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638508154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ab2df-d18c-4075-a3ba-914b4aec2061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:36Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f646b5-1fda-4e5f-9877-13376b00b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f646b5-1fda-4e5f-9877-13376b00b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50163f60-1cc0-4105-8232-88202387b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50163f60-1cc0-4105-8232-88202387b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37ab2df-d18c-4075-a3ba-914b4aec2061', 'volume_name': 'volume-b37ab2df-d18c-4075-a3ba-914b4aec2061', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a19b4f1-3f92-4fc8-bfa6-93e420ad51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a19b4f1-3f92-4fc8-bfa6-93e420ad51c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0060abd0-875f-4784-94a9-0cbd469f9517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Volume b37ab2df-d18c-4075-a3ba-914b4aec2061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37ab2df-d18c-4075-a3ba-914b4aec2061', 'volume_size': 1} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638508154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ab2df-d18c-4075-a3ba-914b4aec2061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:36Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Creating volume b37ab2df-d18c-4075-a3ba-914b4aec2061 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:35 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:35 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 1073741824 Aug 04 12:24:35 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:36 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 1073741824" returned: 0 in 0.557s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:36 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 Aug 04 12:24:36 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:36 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061" returned: 0 in 0.466s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0060abd0-875f-4784-94a9-0cbd469f9517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37ab2df-d18c-4075-a3ba-914b4aec2061', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06ccc4a-2672-457d-b322-09b6e846095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Volume volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 (b37ab2df-d18c-4075-a3ba-914b4aec2061): created successfully Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06ccc4a-2672-457d-b322-09b6e846095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (03f4893c-8e8c-4030-a6a1-68332d936500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e83cb2a5-2f61-4aaa-890e-36f6bda39d4d tempest-AttachVolumeTestJSON-1709467866 None] Created volume successfully. Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Flow 'volume_create_manager' (2e089af5-c9a0-494b-a8fe-ac2e80808be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8dff88-45e3-4c27-a797-3e2c2ad2ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8dff88-45e3-4c27-a797-3e2c2ad2ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883971585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd6969e9-71f5-47b9-9ed1-78675423bfde,host='devstack@QuobyteHD#QuobyteHD',id=6671eb61-f4fc-4267-b122-7e948ac163ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d438ea853b4f188351567d1e478469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:37Z,use_quota=True,user_id='0ddc0e63ec134db3819140297bccc5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f43ad00b-89e9-4e10-a86d-8fb3ff53d475),volume_type_id=f43ad00b-89e9-4e10-a86d-8fb3ff53d475)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54097ccf-93fa-4ab5-a48a-b8b67287b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54097ccf-93fa-4ab5-a48a-b8b67287b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25d5e4c-3a4c-4300-a188-5949cae88b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25d5e4c-3a4c-4300-a188-5949cae88b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6671eb61-f4fc-4267-b122-7e948ac163ef', 'volume_name': 'volume-6671eb61-f4fc-4267-b122-7e948ac163ef', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54838b86-d951-4a89-9719-c96230daaf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54838b86-d951-4a89-9719-c96230daaf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f805f-5104-423c-a230-7ea84305e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Volume 6671eb61-f4fc-4267-b122-7e948ac163ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6671eb61-f4fc-4267-b122-7e948ac163ef', 'volume_size': 1} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd6969e9-71f5-47b9-9ed1-78675423bfde,created_at=2026-08-04T10:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883971585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd6969e9-71f5-47b9-9ed1-78675423bfde,host='devstack@QuobyteHD#QuobyteHD',id=6671eb61-f4fc-4267-b122-7e948ac163ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d438ea853b4f188351567d1e478469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:37Z,use_quota=True,user_id='0ddc0e63ec134db3819140297bccc5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f43ad00b-89e9-4e10-a86d-8fb3ff53d475),volume_type_id=f43ad00b-89e9-4e10-a86d-8fb3ff53d475)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Creating volume 6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:37 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:37 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef 1073741824 Aug 04 12:24:37 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:37 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef 1073741824" returned: 0 in 0.570s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:37 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:37 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:38 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.385s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f805f-5104-423c-a230-7ea84305e482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6671eb61-f4fc-4267-b122-7e948ac163ef', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff01a0a0-39e1-4604-b4c2-521007b0b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Volume volume-6671eb61-f4fc-4267-b122-7e948ac163ef (6671eb61-f4fc-4267-b122-7e948ac163ef): created successfully Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff01a0a0-39e1-4604-b4c2-521007b0b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Flow 'volume_create_manager' (2e089af5-c9a0-494b-a8fe-ac2e80808be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0a289032-0375-4e3d-b065-0bdb0edbd433 tempest-GroupsV314Test-1927025508 None] Created volume successfully. Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-de038fca-e83e-443d-875d-764302fb9a42 req-3efabae3-a386-4723-a553-2ff70b7793f0 tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-de038fca-e83e-443d-875d-764302fb9a42 req-3efabae3-a386-4723-a553-2ff70b7793f0 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-de038fca-e83e-443d-875d-764302fb9a42 req-3efabae3-a386-4723-a553-2ff70b7793f0 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-de038fca-e83e-443d-875d-764302fb9a42 req-3efabae3-a386-4723-a553-2ff70b7793f0 tempest-AttachVolumeTestJSON-1709467866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-b37ab2df-d18c-4075-a3ba-914b4aec2061', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '224855a7-31fe-4d5c-952a-583808ae779f', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:24:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-de038fca-e83e-443d-875d-764302fb9a42 req-3efabae3-a386-4723-a553-2ff70b7793f0 tempest-AttachVolumeTestJSON-1709467866 None] attachment_update completed successfully. Aug 04 12:24:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:40 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Cloning volume 6671eb61-f4fc-4267-b122-7e948ac163ef to volume cf3969b1-16f3-4657-88d8-b8c59feb049e Aug 04 12:24:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Creating offline snapshot 664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 of volume 6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:24:40 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed7394-e8a7-4cef-bfb2-560af7f6fff0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:40 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:40 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:41 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.490s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:41 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 1G Aug 04 12:24:41 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:41 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 1G" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6671eb61-f4fc-4267-b122-7e948ac163ef -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:41 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6671eb61-f4fc-4267-b122-7e948ac163ef -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:41 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (524a19ba-15c6-4f2f-abe1-b1555496c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd43d8-c202-420e-8ed4-5f9a16618652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd43d8-c202-420e-8ed4-5f9a16618652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-251597224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157a46a-f909-4447-8ede-da747ea57890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:42Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b30839-6f2f-40ac-b6f0-6fcdaf7a193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b30839-6f2f-40ac-b6f0-6fcdaf7a193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615bc8ca-c11b-4afa-8dfc-bcc6c5ce158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615bc8ca-c11b-4afa-8dfc-bcc6c5ce158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4157a46a-f909-4447-8ede-da747ea57890', 'volume_name': 'volume-4157a46a-f909-4447-8ede-da747ea57890', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c2ab63-b631-41f5-bef6-dfeb0dd3ee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c2ab63-b631-41f5-bef6-dfeb0dd3ee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b6d1e-4b93-499d-83e1-1803bb5ec1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Volume 4157a46a-f909-4447-8ede-da747ea57890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4157a46a-f909-4447-8ede-da747ea57890', 'volume_size': 1} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Flow 'volume_create_manager' (6a54df61-6d06-4095-8dd3-ac157537433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd17fe03-8694-4181-883b-6a9142332fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd17fe03-8694-4181-883b-6a9142332fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1806980328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443409dc-8ec7-49fd-8734-1e9d99ae2403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b7d18683694718946d0c7324d1dd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:42Z,use_quota=True,user_id='f3609a9629a643d49f5ed48ae854211f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9b3ef8-ba71-4cfc-ad28-742683a54514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9b3ef8-ba71-4cfc-ad28-742683a54514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4d1fc1-cf31-4b9a-a829-cf41a7367f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4d1fc1-cf31-4b9a-a829-cf41a7367f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443409dc-8ec7-49fd-8734-1e9d99ae2403', 'volume_name': 'volume-443409dc-8ec7-49fd-8734-1e9d99ae2403', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:41 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae2ec8-d372-4e76-96a6-859c7f423b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfae2ec8-d372-4e76-96a6-859c7f423b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1976f1-3079-4f71-964c-1a894e376d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:42 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Volume 443409dc-8ec7-49fd-8734-1e9d99ae2403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443409dc-8ec7-49fd-8734-1e9d99ae2403', 'volume_size': 1} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6671eb61-f4fc-4267-b122-7e948ac163ef -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.431s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:42 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:42 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:42 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:42 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.242s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:42 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info Aug 04 12:24:42 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:42 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info" returned: 0 in 0.260s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:42 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:42 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info Aug 04 12:24:42 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:42 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.info" returned: 0 in 0.254s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Acquiring lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] snapshot: 664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8, volume: cf3969b1-16f3-4657-88d8-b8c59feb049e, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e198ed-197d-476e-a79e-24651adce238]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:42 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:42 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:43 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.380s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6671eb61-f4fc-4267-b122-7e948ac163ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee15536-a8fe-4318-bf40-431c0795032d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:43 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:43 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:43 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:24:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:43 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e Aug 04 12:24:43 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=128,cinder:INSERT=33,cinder:UPDATE=139,cinder:DELETE=8 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=129,cinder:UPDATE=120,cinder:INSERT=33,cinder:DELETE=8 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Flow 'volume_create_manager' (3279e9a2-4aef-4ca6-a81a-842aef24214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52692d6b-2363-4476-8dbc-b57b043365c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52692d6b-2363-4476-8dbc-b57b043365c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-780673317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127a5c2f-bf34-4ea1-aa05-a82ff21ea0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e288c0b0880247dea1e4979937892f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:44Z,use_quota=True,user_id='674b5bc9e3b943e78eebd0e9ef20aca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd9526e-be1f-4092-aa62-b0ddf9178b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd9526e-be1f-4092-aa62-b0ddf9178b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf9a25e-05aa-4a26-a9fc-c045721601b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf9a25e-05aa-4a26-a9fc-c045721601b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127a5c2f-bf34-4ea1-aa05-a82ff21ea0da', 'volume_name': 'volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b92d8c3-b61a-4b5b-aee3-327fb668fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b92d8c3-b61a-4b5b-aee3-327fb668fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3a852-1d75-4e3f-b2b0-610f31efbae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:44 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume 127a5c2f-bf34-4ea1-aa05-a82ff21ea0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da', 'volume_size': 1} Aug 04 12:24:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:47 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e" returned: 0 in 4.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:47 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:24:47 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Converted 1024.00 MB image at 235.91 MB/s Aug 04 12:24:48 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e is being set with open permissions: ugo+rw: NotImplementedError Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:48 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e Aug 04 12:24:48 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:48 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" released by "_copy_volume_from_snapshot" :: held 5.409s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Acquiring lock "cinder-quobyte-664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Deleting offline snapshot 664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 of volume 6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] snapshot_file for this snap is: volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6108e-8efb-4913-8360-4945826278d7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:48 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:48 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:48 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.365s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6671eb61-f4fc-4267-b122-7e948ac163ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b01cfd-308c-40fb-a0a2-965b1ee6c620]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:48 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:48 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:49 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.519s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:49 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:49 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:49 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:49 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8 Aug 04 12:24:49 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:49 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef.664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-664c050c-1dd6-4bb3-ba55-68c9f5ce1ee8" released by "_delete_snapshot" :: held 1.562s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.363s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.050s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-251597224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157a46a-f909-4447-8ede-da747ea57890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf0a5a51aed42cf98713adae520c001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:42Z,use_quota=True,user_id='dddf68b3a24141c5b7fc5d95b3f068fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Creating volume 4157a46a-f909-4447-8ede-da747ea57890 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:49 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:49 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 1073741824 Aug 04 12:24:49 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c19c586e-a452-4f31-88c4-b0132b705e1b tempest-GroupsV314Test-1927025508 None] Create group from source-group-fd6969e9-71f5-47b9-9ed1-78675423bfde completed successfully. Aug 04 12:24:50 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 1073741824" returned: 0 in 0.413s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:50 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 Aug 04 12:24:50 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:50 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890" returned: 0 in 0.242s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.552s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1806980328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443409dc-8ec7-49fd-8734-1e9d99ae2403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b7d18683694718946d0c7324d1dd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:42Z,use_quota=True,user_id='f3609a9629a643d49f5ed48ae854211f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Creating volume 443409dc-8ec7-49fd-8734-1e9d99ae2403 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:50 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 1073741824 Aug 04 12:24:50 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b6d1e-4b93-499d-83e1-1803bb5ec1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4157a46a-f909-4447-8ede-da747ea57890', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c48be9b-5fb6-4320-948d-29866e82facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Volume volume-4157a46a-f909-4447-8ede-da747ea57890 (4157a46a-f909-4447-8ede-da747ea57890): created successfully Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c48be9b-5fb6-4320-948d-29866e82facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Flow 'volume_create_manager' (524a19ba-15c6-4f2f-abe1-b1555496c2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d883e67a-f977-4b2e-b1f3-1269c9aa0995 tempest-AttachVolumeTestJSON-1709467866 None] Created volume successfully. Aug 04 12:24:51 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 1073741824" returned: 0 in 0.453s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:51 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 Aug 04 12:24:51 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Acquiring lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:51 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403" returned: 0 in 0.277s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.216s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-780673317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127a5c2f-bf34-4ea1-aa05-a82ff21ea0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e288c0b0880247dea1e4979937892f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:44Z,use_quota=True,user_id='674b5bc9e3b943e78eebd0e9ef20aca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Creating volume 127a5c2f-bf34-4ea1-aa05-a82ff21ea0da {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:51 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afece5a-ae88-4596-9743-06c5ba52c8ba]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:51 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da 1073741824 Aug 04 12:24:51 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1976f1-3079-4f71-964c-1a894e376d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443409dc-8ec7-49fd-8734-1e9d99ae2403', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbcf2c9-ad08-4fbd-a444-8564c6a74a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Volume volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 (443409dc-8ec7-49fd-8734-1e9d99ae2403): created successfully Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbcf2c9-ad08-4fbd-a444-8564c6a74a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Flow 'volume_create_manager' (6a54df61-6d06-4095-8dd3-ac157537433d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2029a708-1da5-457f-b43c-ed3f6afe6434 tempest-VolumesServicesTestJSON-1753516981 None] Created volume successfully. Aug 04 12:24:51 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e Aug 04 12:24:51 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:51 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e" returned: 0 in 0.490s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:51 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e Aug 04 12:24:51 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Acquiring lock "cinder-443409dc-8ec7-49fd-8734-1e9d99ae2403-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "cinder-443409dc-8ec7-49fd-8734-1e9d99ae2403-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:52 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Acquiring lock "cinder-quobyte-443409dc-8ec7-49fd-8734-1e9d99ae2403" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da 1073741824" returned: 0 in 0.681s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "cinder-quobyte-443409dc-8ec7-49fd-8734-1e9d99ae2403" acquired by "delete_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3f690-432f-41f4-830d-ad5376874672]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:52 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da Aug 04 12:24:52 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:52 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf3969b1-16f3-4657-88d8-b8c59feb049e" returned: 0 in 0.362s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:52 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 Aug 04 12:24:52 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-cf3969b1-16f3-4657-88d8-b8c59feb049e" released by "delete_volume" :: held 0.933s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Created reservations ['00b62d3b-dec0-4934-9464-f93eee33a1f3'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-656fffe5-d91c-4d6b-a237-0f6d4c6adf0b req-72e27362-6dac-473c-becc-11de31599aa4 tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:52 devstack cinder-volume[88895]: WARNING cinder.quota [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1147520975 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1147520975, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:24:52 devstack cinder-volume[88895]: WARNING cinder.quota [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1147520975 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1147520975, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:24:52 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" returned: 0 in 0.276s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-656fffe5-d91c-4d6b-a237-0f6d4c6adf0b req-72e27362-6dac-473c-becc-11de31599aa4 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.049s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Created reservations ['0a3f5254-9e3a-4779-abaf-52d1f2748c34', '0dcd7ab9-66e3-4602-9871-429a4b88b30a', '94e60853-3e7c-4f8d-9834-0fd37c17f0b8', 'a3d32df3-fa0a-4131-8a30-627b208d0e94'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3a852-1d75-4e3f-b2b0-610f31efbae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aed065-d217-4271-b800-a8aee9c9f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da (127a5c2f-bf34-4ea1-aa05-a82ff21ea0da): created successfully Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aed065-d217-4271-b800-a8aee9c9f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Flow 'volume_create_manager' (3279e9a2-4aef-4ca6-a81a-842aef24214c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-656fffe5-d91c-4d6b-a237-0f6d4c6adf0b req-72e27362-6dac-473c-becc-11de31599aa4 tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.116s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9443f26c-8b75-4305-842b-f93df9fb4022 tempest-VolumeQuotasAdminTestJSON-242570671 None] Created volume successfully. Aug 04 12:24:52 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:52 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403 Aug 04 12:24:52 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-656fffe5-d91c-4d6b-a237-0f6d4c6adf0b req-72e27362-6dac-473c-becc-11de31599aa4 tempest-AttachVolumeTestJSON-1709467866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-4157a46a-f909-4447-8ede-da747ea57890', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0693f386-10d1-4334-8047-80d76cbe0bac', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:24:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-656fffe5-d91c-4d6b-a237-0f6d4c6adf0b req-72e27362-6dac-473c-becc-11de31599aa4 tempest-AttachVolumeTestJSON-1709467866 None] attachment_update completed successfully. Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:52 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:52 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:52 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-443409dc-8ec7-49fd-8734-1e9d99ae2403" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "cinder-quobyte-443409dc-8ec7-49fd-8734-1e9d99ae2403" released by "delete_volume" :: held 0.792s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Created reservations ['1278513b-92bc-4c56-8bf4-f4e54f65881e', 'c9baa21d-1dbd-4cf9-83f6-124db6806afe', '449c1771-fb97-4977-a9d9-5ebd5cb469f9', 'bea8b10c-9aff-49d7-aea1-a041b39ffeda'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "cinder-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "cinder-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:52 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6078c7d9-4f9a-4d9f-9592-47e5ed719bdc tempest-GroupsV314Test-1927025508 None] Delete group completed successfully. Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "cinder-quobyte-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "cinder-quobyte-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:53 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:53 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ade423-75a4-45b3-bda2-11ccf43882d2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:53 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da Aug 04 12:24:53 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:53 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.345s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Deleted volume successfully. Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6bba06-1eb9-4047-b902-32ff57acf2fa tempest-VolumesServicesTestJSON-1753516981 None] Lock "cinder-443409dc-8ec7-49fd-8734-1e9d99ae2403-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:53 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" returned: 0 in 0.479s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:53 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da Aug 04 12:24:53 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:53 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "cinder-quobyte-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da" released by "delete_volume" :: held 0.813s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Acquiring lock "cinder-quobyte-6671eb61-f4fc-4267-b122-7e948ac163ef" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:24:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-6671eb61-f4fc-4267-b122-7e948ac163ef" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0c9e6-c57d-4b15-bbc5-5de53f357bb0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Created reservations ['f33779c1-81b2-4e71-aac9-35c1a39b029e', 'fb270f48-e5f9-49f7-9608-340cfc77a418', '79699977-52e0-4253-82ce-72ac47b3e9b3', 'e3f8b691-f9b5-417b-afda-a12d4cf79cc1'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:54 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:54 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:54 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:54 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:54 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.530s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:54 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.389s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:54 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef Aug 04 12:24:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Deleted volume successfully. Aug 04 12:24:54 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7b8cdfa-409c-481f-be07-bcdc8c0c5649 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "cinder-127a5c2f-bf34-4ea1-aa05-a82ff21ea0da-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:54 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6671eb61-f4fc-4267-b122-7e948ac163ef" returned: 0 in 0.268s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Lock "cinder-quobyte-6671eb61-f4fc-4267-b122-7e948ac163ef" released by "delete_volume" :: held 0.882s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Created reservations ['72eecad6-af64-4fb2-95f8-c780a62f87fa'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:54 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Created reservations ['858450a0-f9a5-48e9-94c6-606df123e63a', '758dfa81-e2b2-4205-808e-7ded5bf944a7', '58b58622-d5e3-4fef-9cc7-3e4df37d99fd', '60ad7345-f017-4883-a252-c8473a6046cb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:55 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:24:55 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:55 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.412s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:24:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-91dafa00-0614-4a24-92b3-e07bbe5cc514 tempest-GroupsV314Test-1927025508 None] Delete group completed successfully. Aug 04 12:24:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-7eeb3d3b-d2f1-46e5-a89c-f66e4a3b3416 req-91d0575a-e472-4a71-81e7-ec3850f67372 tempest-AttachVolumeTestJSON-1709467866 None] Terminate volume connection completed successfully. Aug 04 12:24:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-7eeb3d3b-d2f1-46e5-a89c-f66e4a3b3416 req-91d0575a-e472-4a71-81e7-ec3850f67372 tempest-AttachVolumeTestJSON-1709467866 None] Deleting attachment 224855a7-31fe-4d5c-952a-583808ae779f. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Flow 'volume_create_manager' (0a37d0b7-c83b-406f-b18a-9244a9aa48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe3f0c4-63f7-4abe-b12c-2bc3dd0584ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe3f0c4-63f7-4abe-b12c-2bc3dd0584ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-795760532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecba04a-7a55-414c-85ee-611871ccaa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e288c0b0880247dea1e4979937892f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:56Z,use_quota=True,user_id='674b5bc9e3b943e78eebd0e9ef20aca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb58fd75-d674-485d-8bcd-8ba3f7072066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb58fd75-d674-485d-8bcd-8ba3f7072066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ced7dd-85fb-433b-8e77-7d3f8b6f59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ced7dd-85fb-433b-8e77-7d3f8b6f59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecba04a-7a55-414c-85ee-611871ccaa52', 'volume_name': 'volume-2ecba04a-7a55-414c-85ee-611871ccaa52', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abc1414-81ee-419d-a8f4-8785446e6b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abc1414-81ee-419d-a8f4-8785446e6b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03a86a0-9d98-4ee7-952a-b387da8f3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume 2ecba04a-7a55-414c-85ee-611871ccaa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecba04a-7a55-414c-85ee-611871ccaa52', 'volume_size': 1} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-795760532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecba04a-7a55-414c-85ee-611871ccaa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e288c0b0880247dea1e4979937892f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:24:56Z,use_quota=True,user_id='674b5bc9e3b943e78eebd0e9ef20aca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Creating volume 2ecba04a-7a55-414c-85ee-611871ccaa52 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:24:56 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:56 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 1073741824 Aug 04 12:24:56 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:56 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 1073741824" returned: 0 in 0.699s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:24:56 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 Aug 04 12:24:56 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:24:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-018db669-3579-4054-99cf-886bcdb9f352 req-ef0299c2-d417-47cf-a021-dbb7221035d0 tempest-AttachVolumeTestJSON-1709467866 None] Terminate volume connection completed successfully. Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-018db669-3579-4054-99cf-886bcdb9f352 req-ef0299c2-d417-47cf-a021-dbb7221035d0 tempest-AttachVolumeTestJSON-1709467866 None] Deleting attachment 0693f386-10d1-4334-8047-80d76cbe0bac. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:24:57 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03a86a0-9d98-4ee7-952a-b387da8f3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecba04a-7a55-414c-85ee-611871ccaa52', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f8ae0c-ef5e-445b-91d6-d17c419c6527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:24:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Volume volume-2ecba04a-7a55-414c-85ee-611871ccaa52 (2ecba04a-7a55-414c-85ee-611871ccaa52): created successfully Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f8ae0c-ef5e-445b-91d6-d17c419c6527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:24:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Flow 'volume_create_manager' (0a37d0b7-c83b-406f-b18a-9244a9aa48e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:24:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3d5457e6-634d-4d4b-854a-6c05e3d3ddf1 tempest-VolumeQuotasAdminTestJSON-242570671 None] Created volume successfully. Aug 04 12:24:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-20b6ab40-cfe7-4040-8813-0264515f2234 tempest-VolumeQuotasAdminTestJSON-367160115 None] Transfer volume completed successfully. Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (90182206-d130-4979-aa46-4bbbe533ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91236bb-0212-4a28-9aaa-74701885f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91236bb-0212-4a28-9aaa-74701885f593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-849582603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4caca0ca-7743-47f0-baf5-3e350b0e728d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:00Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e562048e-c94d-42d0-80b3-77f9834c4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e562048e-c94d-42d0-80b3-77f9834c4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00070d5-264a-4232-b0f5-51b89555aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00070d5-264a-4232-b0f5-51b89555aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4caca0ca-7743-47f0-baf5-3e350b0e728d', 'volume_name': 'volume-4caca0ca-7743-47f0-baf5-3e350b0e728d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5e3cf1-33b3-4fbf-ac6c-f765aa56d8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5e3cf1-33b3-4fbf-ac6c-f765aa56d8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ded26bd-c923-4db9-9ec1-6a8c75197764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Volume 4caca0ca-7743-47f0-baf5-3e350b0e728d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4caca0ca-7743-47f0-baf5-3e350b0e728d', 'volume_size': 1} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-849582603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4caca0ca-7743-47f0-baf5-3e350b0e728d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:00Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Creating volume 4caca0ca-7743-47f0-baf5-3e350b0e728d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:00 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Acquiring lock "cinder-2ecba04a-7a55-414c-85ee-611871ccaa52-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:00 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d 1073741824 Aug 04 12:25:00 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "cinder-2ecba04a-7a55-414c-85ee-611871ccaa52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Acquiring lock "cinder-quobyte-2ecba04a-7a55-414c-85ee-611871ccaa52" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "cinder-quobyte-2ecba04a-7a55-414c-85ee-611871ccaa52" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aace7ca-ae1d-433e-b90d-e1d9b9561407]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:00 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 Aug 04 12:25:00 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:01 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d 1073741824" returned: 0 in 0.622s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:01 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d Aug 04 12:25:01 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:01 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52" returned: 0 in 0.534s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:01 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52 Aug 04 12:25:01 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:01 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ded26bd-c923-4db9-9ec1-6a8c75197764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4caca0ca-7743-47f0-baf5-3e350b0e728d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06dbf972-803d-4dd5-9891-d5edfc480fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:01 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Volume volume-4caca0ca-7743-47f0-baf5-3e350b0e728d (4caca0ca-7743-47f0-baf5-3e350b0e728d): created successfully Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06dbf972-803d-4dd5-9891-d5edfc480fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (90182206-d130-4979-aa46-4bbbe533ff17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2ecba04a-7a55-414c-85ee-611871ccaa52" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "cinder-quobyte-2ecba04a-7a55-414c-85ee-611871ccaa52" released by "delete_volume" :: held 0.941s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3c20fccb-5ab2-431f-a37a-fb0f77715243 tempest-VolumesListAdminTestJSON-1134314608 None] Created volume successfully. Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Created reservations ['bd47b6a9-feeb-4da3-8926-3965a7708e72', '60b3b5d5-5add-4598-872c-1e788bfc6abf', '00f56f7f-8e9b-4670-be6b-c908eb00fc8b', '7d482488-832d-4a6e-a2d2-7e316dc485ec'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:01 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:01 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:02 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:02 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Deleted volume successfully. Aug 04 12:25:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0028594c-4f5f-489d-8878-aee598ccf886 tempest-VolumeQuotasAdminTestJSON-1147248546 None] Lock "cinder-2ecba04a-7a55-414c-85ee-611871ccaa52-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-4157a46a-f909-4447-8ede-da747ea57890-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-4157a46a-f909-4447-8ede-da747ea57890-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-quobyte-4157a46a-f909-4447-8ede-da747ea57890" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-4157a46a-f909-4447-8ede-da747ea57890" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (ba5d979f-40e0-4712-8f68-18ff40adc1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea8533b-e59b-486e-bf43-b6cd65dfd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf7884-455f-453f-b767-051a97e03391]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea8533b-e59b-486e-bf43-b6cd65dfd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574878159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ffdaf6-cf19-4405-ba40-80abb8149dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:03Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6e202a-1005-4cbb-85ec-d3f08a88e195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6e202a-1005-4cbb-85ec-d3f08a88e195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bdbc5-8f9c-4a6d-b3d8-b22c25ad3e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bdbc5-8f9c-4a6d-b3d8-b22c25ad3e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ffdaf6-cf19-4405-ba40-80abb8149dc3', 'volume_name': 'volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d75272-71f1-449f-981c-c84dd5af9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d75272-71f1-449f-981c-c84dd5af9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaade7c-329d-4182-bb0b-21b69005e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:03 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Volume 95ffdaf6-cf19-4405-ba40-80abb8149dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3', 'volume_size': 1} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574878159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ffdaf6-cf19-4405-ba40-80abb8149dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:03Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Creating volume 95ffdaf6-cf19-4405-ba40-80abb8149dc3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:03 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:03 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 1073741824 Aug 04 12:25:03 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:03 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 Aug 04 12:25:03 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:03 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:03 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890 Aug 04 12:25:03 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:04 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 1073741824" returned: 0 in 0.553s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:04 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 Aug 04 12:25:04 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:04 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4157a46a-f909-4447-8ede-da747ea57890" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-4157a46a-f909-4447-8ede-da747ea57890" released by "delete_volume" :: held 0.838s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Created reservations ['565763ac-afc9-4942-a90c-3093917e27e3', '8d228666-4718-4a81-b75e-db6a1a0bb699', 'f7b68fdf-642a-4f0a-b3c3-bb4404d5568f', 'bc3cb161-1e02-47cb-9701-90bc18be4b2b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:04 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:04 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-b37ab2df-d18c-4075-a3ba-914b4aec2061-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:04 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-b37ab2df-d18c-4075-a3ba-914b4aec2061-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3" returned: 0 in 0.469s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaade7c-329d-4182-bb0b-21b69005e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac3ddaa-e200-4c0e-8414-8186d39b2a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-quobyte-b37ab2df-d18c-4075-a3ba-914b4aec2061" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Volume volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 (95ffdaf6-cf19-4405-ba40-80abb8149dc3): created successfully Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac3ddaa-e200-4c0e-8414-8186d39b2a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (ba5d979f-40e0-4712-8f68-18ff40adc1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-b37ab2df-d18c-4075-a3ba-914b4aec2061" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-521816a3-1666-4236-bf2a-959d103d30ae tempest-VolumesListAdminTestJSON-1134314608 None] Created volume successfully. Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[729ba401-4edf-4f07-8bbe-f48e8c3cfbc8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:04 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Deleted volume successfully. Aug 04 12:25:04 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 Aug 04 12:25:05 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2b2e88cd-a857-49b0-acb7-7633785dbc9e tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-4157a46a-f909-4447-8ede-da747ea57890-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:05 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061" returned: 0 in 0.551s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:05 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061 Aug 04 12:25:05 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:05 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b37ab2df-d18c-4075-a3ba-914b4aec2061" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-b37ab2df-d18c-4075-a3ba-914b4aec2061" released by "delete_volume" :: held 1.012s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Created reservations ['c0749e77-f48d-41ce-849a-435db1075808', '00b75f54-2969-4d90-8abe-be1258bd64a6', 'bb131ced-436d-43af-b273-3d8a369f66bd', '08434636-43ae-4876-8be7-56e3531fda2b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:05 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:05 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (549080f0-dd97-4b59-b28d-a34491953d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277243e6-befd-483e-b9c1-0235fffae19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277243e6-befd-483e-b9c1-0235fffae19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-556426123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651695c5-2043-4ccc-967c-a8f60ec3a039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:06Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb43c3-8c90-4246-a81d-d382869d3348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bb43c3-8c90-4246-a81d-d382869d3348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f096f5-9f6a-44d1-8d0f-f1802150cba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f096f5-9f6a-44d1-8d0f-f1802150cba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651695c5-2043-4ccc-967c-a8f60ec3a039', 'volume_name': 'volume-651695c5-2043-4ccc-967c-a8f60ec3a039', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af33359-083a-41ce-8ab0-844c01d7877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af33359-083a-41ce-8ab0-844c01d7877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c62cd04-7667-4f70-b548-e9e723626b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Volume 651695c5-2043-4ccc-967c-a8f60ec3a039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651695c5-2043-4ccc-967c-a8f60ec3a039', 'volume_size': 1} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-556426123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651695c5-2043-4ccc-967c-a8f60ec3a039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d77aabddd3441c781cd2e0aa9d97eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:06Z,use_quota=True,user_id='f22e72cc95824346bef30ab7a59764a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Creating volume 651695c5-2043-4ccc-967c-a8f60ec3a039 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:06 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:06 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Deleted volume successfully. Aug 04 12:25:06 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 1073741824 Aug 04 12:25:06 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:06 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:06 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ee613623-a8c7-4ece-9fab-a2f745c5c84f tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-b37ab2df-d18c-4075-a3ba-914b4aec2061-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:06 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:25:06 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 1073741824" returned: 0 in 0.567s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:06 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 Aug 04 12:25:06 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "cinder-quobyte-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:07 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039" returned: 0 in 0.349s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c62cd04-7667-4f70-b548-e9e723626b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651695c5-2043-4ccc-967c-a8f60ec3a039', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f80e34-08e5-4c43-b2b9-52d5d4a945dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f23009-a2ac-4033-9482-2556b11387fb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:07 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Volume volume-651695c5-2043-4ccc-967c-a8f60ec3a039 (651695c5-2043-4ccc-967c-a8f60ec3a039): created successfully Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f80e34-08e5-4c43-b2b9-52d5d4a945dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Flow 'volume_create_manager' (549080f0-dd97-4b59-b28d-a34491953d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-baba8d34-0509-47fe-8a5f-7a8dfa54e7df tempest-VolumesListAdminTestJSON-1134314608 None] Created volume successfully. Aug 04 12:25:07 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 Aug 04 12:25:07 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:07 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" returned: 0 in 0.453s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:07 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63 Aug 04 12:25:07 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:07 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" returned: 0 in 0.260s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-quobyte-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63" released by "delete_volume" :: held 0.772s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Created reservations ['c3140e22-e6a1-456f-8a2e-4df651a8091b', 'f5f62b80-f602-43d9-bec5-c32ab2a1d926', 'f8bd05c8-918e-467c-8985-bb70f5837c23', '94fa178f-5cc1-4a24-816b-dcd42d6830f4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:08 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:08 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:08 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.375s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Deleted volume successfully. Aug 04 12:25:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b26136c7-1a54-43d8-ac30-1516148da19a tempest-AttachVolumeTestJSON-1709467866 None] Lock "cinder-9c505a7f-5aeb-4f8e-a2b9-1fe16dd89a63-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Flow 'volume_create_manager' (37093ab9-9c58-431a-92e0-f30d72e35fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8765d498-3902-4efa-b9e7-7d019548bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8765d498-3902-4efa-b9e7-7d019548bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d36de31474a65b2e7bbea717287cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:09Z,use_quota=True,user_id='dff4f8d3491f4f2483a268cfe8b10b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6592d0b9-8568-4ba3-b857-0b14577eb05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6592d0b9-8568-4ba3-b857-0b14577eb05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a798996c-dfe8-4446-90b5-24ee2268ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a798996c-dfe8-4446-90b5-24ee2268ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7', 'volume_name': 'volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1125dbd3-1790-4e01-80e7-b58a927196ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1125dbd3-1790-4e01-80e7-b58a927196ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6373df86-02b2-4723-9552-145599043aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:09 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Volume 16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7', 'volume_size': 1} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690d36de31474a65b2e7bbea717287cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:09Z,use_quota=True,user_id='dff4f8d3491f4f2483a268cfe8b10b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Creating volume 16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:09 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:09 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 1073741824 Aug 04 12:25:09 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:10 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 1073741824" returned: 0 in 0.525s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:10 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 Aug 04 12:25:10 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:10 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" returned: 0 in 0.313s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6373df86-02b2-4723-9552-145599043aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb8dfd7-84db-4397-a1b4-4d42c379f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:10 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Volume volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 (16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7): created successfully Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb8dfd7-84db-4397-a1b4-4d42c379f31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Flow 'volume_create_manager' (37093ab9-9c58-431a-92e0-f30d72e35fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f6c19ada-1f2d-4e39-b6ea-5f71f0601531 tempest-VolumesListAdminTestJSON-1980892809 None] Created volume successfully. Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Acquiring lock "cinder-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "cinder-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Acquiring lock "cinder-quobyte-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "cinder-quobyte-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[56127150-e196-4e28-b33e-0e0f90f3e320]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-651695c5-2043-4ccc-967c-a8f60ec3a039-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-651695c5-2043-4ccc-967c-a8f60ec3a039-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-quobyte-651695c5-2043-4ccc-967c-a8f60ec3a039" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:11 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 Aug 04 12:25:11 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-651695c5-2043-4ccc-967c-a8f60ec3a039" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8d84d-303c-4c08-b698-6116a1ca679a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:12 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 Aug 04 12:25:12 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:12 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" returned: 0 in 0.627s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:12 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7 Aug 04 12:25:12 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:12 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039" returned: 0 in 0.641s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:12 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039 Aug 04 12:25:12 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:12 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" returned: 0 in 0.398s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "cinder-quobyte-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7" released by "delete_volume" :: held 1.112s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:12 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Created reservations ['6c93e0d4-f544-4ab7-b6da-6492f031ff51', 'bc4d4dfe-7f01-4130-8ce8-6ff3087ceea8', '86b694b1-9e0f-4147-afa6-4c2e53cf1402', 'efd7eb2e-6c98-4412-b329-d5dc306a1ed8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:13 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:13 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:13 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-651695c5-2043-4ccc-967c-a8f60ec3a039" returned: 0 in 0.512s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-651695c5-2043-4ccc-967c-a8f60ec3a039" released by "delete_volume" :: held 1.217s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Created reservations ['808ae179-5c3b-4855-849b-547e46eca08c', '4889fb82-e30b-49d3-b4d3-3efc61fe2c4e', '04fe38f0-903a-4e14-9336-9aa6e2e29944', '258e5627-c64c-4cc6-9094-75e00c176ace'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:13 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.391s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Deleted volume successfully. Aug 04 12:25:13 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:13 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2a1ef99a-b5e5-4fb3-ad11-88913a55a13e tempest-VolumesListAdminTestJSON-1980892809 None] Lock "cinder-16ad0c0c-3e94-4a37-9b25-a6a1d07b3cd7-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:13 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.478s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:13 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Deleted volume successfully. Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4103a4e1-6078-437b-8d02-64cf9e741e72 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-651695c5-2043-4ccc-967c-a8f60ec3a039-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-95ffdaf6-cf19-4405-ba40-80abb8149dc3-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-95ffdaf6-cf19-4405-ba40-80abb8149dc3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-quobyte-95ffdaf6-cf19-4405-ba40-80abb8149dc3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-95ffdaf6-cf19-4405-ba40-80abb8149dc3" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbe94cc-6115-4baa-8cd4-be2fc626e26c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:14 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 Aug 04 12:25:14 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:14 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3" returned: 0 in 0.458s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:14 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3 Aug 04 12:25:14 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:15 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95ffdaf6-cf19-4405-ba40-80abb8149dc3" returned: 0 in 0.308s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-95ffdaf6-cf19-4405-ba40-80abb8149dc3" released by "delete_volume" :: held 0.836s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Created reservations ['0ae3f3f4-b565-4141-b002-50201937d1ee', '6d4efb9b-5ba5-4b02-b063-306ec96e0bea', 'dcaade0d-8113-48e1-8a78-992541d358b5', 'b7ea984c-7966-4911-a479-c6e900a7975a'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:15 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:15 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-4caca0ca-7743-47f0-baf5-3e350b0e728d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-4caca0ca-7743-47f0-baf5-3e350b0e728d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:15 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "cinder-quobyte-4caca0ca-7743-47f0-baf5-3e350b0e728d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.328s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Deleted volume successfully. Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-4caca0ca-7743-47f0-baf5-3e350b0e728d" acquired by "delete_volume" :: waited 0.038s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-84b9f89e-a95c-4c0c-960e-c0ee58c89fcf tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-95ffdaf6-cf19-4405-ba40-80abb8149dc3-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4edd3f0-3b57-4e83-9878-bc1a73d52479]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:16 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d Aug 04 12:25:16 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:16 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d" returned: 0 in 0.525s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:16 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d Aug 04 12:25:16 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:16 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4caca0ca-7743-47f0-baf5-3e350b0e728d" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-quobyte-4caca0ca-7743-47f0-baf5-3e350b0e728d" released by "delete_volume" :: held 0.926s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Created reservations ['ba2ad622-0ee5-49e6-bcff-a072d979dd26', 'adf098fc-6b66-4639-9ee8-36eb10f468c0', '74e53e98-aba6-4561-9b41-70ea6745ba1c', '0f4287e8-9d75-4da6-9b89-5315f11f4516'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:16 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:16 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:17 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.308s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:17 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Deleted volume successfully. Aug 04 12:25:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65a62977-3f37-4de3-9157-9828edd19268 tempest-VolumesListAdminTestJSON-1134314608 None] Lock "cinder-4caca0ca-7743-47f0-baf5-3e350b0e728d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Flow 'volume_create_manager' (20e63f70-0d05-464a-9f83-3f1d1911dc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c3996-9fa5-4110-bdf8-4a520d10eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c3996-9fa5-4110-bdf8-4a520d10eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-225258025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb4bb3-82a2-417d-b7c6-74dd3c7e839c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a19fd3b500e4493aa297ba9fcb66915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:22Z,use_quota=True,user_id='bab2a89b5563453cb2772c78c704f7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47cde85-9610-4a2f-9aed-e115aff70b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47cde85-9610-4a2f-9aed-e115aff70b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb5561d-d6b3-4952-b32e-809d05a0a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb5561d-d6b3-4952-b32e-809d05a0a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fb4bb3-82a2-417d-b7c6-74dd3c7e839c', 'volume_name': 'volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ee09ad-b7e4-4ab5-86f8-d0cda8fa14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ee09ad-b7e4-4ab5-86f8-d0cda8fa14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30078bba-756b-4fbd-a1b9-9abda4a3025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Volume 09fb4bb3-82a2-417d-b7c6-74dd3c7e839c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c', 'volume_size': 1} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-225258025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb4bb3-82a2-417d-b7c6-74dd3c7e839c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a19fd3b500e4493aa297ba9fcb66915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:22Z,use_quota=True,user_id='bab2a89b5563453cb2772c78c704f7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Creating volume 09fb4bb3-82a2-417d-b7c6-74dd3c7e839c {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:22 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:22 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c 1073741824 Aug 04 12:25:22 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:22 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c 1073741824" returned: 0 in 0.595s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:22 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c Aug 04 12:25:22 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:23 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" returned: 0 in 0.428s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30078bba-756b-4fbd-a1b9-9abda4a3025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84fb2e5-148b-46a3-93ef-c70ae92ab0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Volume volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c (09fb4bb3-82a2-417d-b7c6-74dd3c7e839c): created successfully Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84fb2e5-148b-46a3-93ef-c70ae92ab0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Flow 'volume_create_manager' (20e63f70-0d05-464a-9f83-3f1d1911dc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-aaa2243e-7612-4fb2-87d5-6268b3462525 tempest-VolumeQuotasNegativeTestJSON-90799390 None] Created volume successfully. Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Acquiring lock "cinder-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "cinder-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Acquiring lock "cinder-quobyte-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "cinder-quobyte-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3a771-06b9-411b-ac7e-fce7f3a294fc]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:25 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c Aug 04 12:25:25 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:26 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" returned: 0 in 0.467s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:26 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c Aug 04 12:25:26 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:26 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" returned: 0 in 0.414s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "cinder-quobyte-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c" released by "delete_volume" :: held 0.943s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Created reservations ['e5768939-d310-46b6-8f65-67179a068654', '3fd85dfc-d9df-451e-9a18-4e0627a856ab', '7bc700bf-4e67-49a4-b77f-9934748812d4', '20b81620-20d4-4ae6-af55-b8176acbcc5e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:26 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:26 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:27 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:27 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Deleted volume successfully. Aug 04 12:25:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7f9196e1-9769-4e3a-9bed-98683a09b66f tempest-VolumeQuotasNegativeTestJSON-90799390 None] Lock "cinder-09fb4bb3-82a2-417d-b7c6-74dd3c7e839c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Flow 'volume_create_manager' (82c9ba68-3ce0-4c87-a0ef-1f7c3c3857f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd99245c-a9cf-4d08-9e84-eb61c752a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd99245c-a9cf-4d08-9e84-eb61c752a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-656345717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b540150d-748c-4b27-9903-80c3eee75eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1acdbbe26b4cb2ad18527e5873d0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:31Z,use_quota=True,user_id='790d046060a049baa5e81f852afef166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182e45ac-a04e-4806-b54b-11e447f54ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182e45ac-a04e-4806-b54b-11e447f54ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28798b41-8fd1-48ed-ac61-0701cb0b1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:30 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28798b41-8fd1-48ed-ac61-0701cb0b1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b540150d-748c-4b27-9903-80c3eee75eaf', 'volume_name': 'volume-b540150d-748c-4b27-9903-80c3eee75eaf', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824f3d06-c5a6-4a3d-85e7-42bffe27b994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824f3d06-c5a6-4a3d-85e7-42bffe27b994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e953779-c660-40e8-bd3b-41b7e9780b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Volume b540150d-748c-4b27-9903-80c3eee75eaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b540150d-748c-4b27-9903-80c3eee75eaf', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Trying to clone b540150d-748c-4b27-9903-80c3eee75eaf from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:25:31 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:25:31 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Image download 20.69 MB at 20.69 MB/s Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c784f3f-76f6-4e53-96b5-da1843e6580d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:32 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD Aug 04 12:25:32 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:32 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 is fetched for user 790d046060a049baa5e81f852afef166. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19775c7-b910-4b7d-b92a-dfa03bd2d3f8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:32 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD Aug 04 12:25:32 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:32 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-656345717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b540150d-748c-4b27-9903-80c3eee75eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1acdbbe26b4cb2ad18527e5873d0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:31Z,use_quota=True,user_id='790d046060a049baa5e81f852afef166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Creating volume b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:32 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:33 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1073741824 Aug 04 12:25:33 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:33 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1073741824" returned: 0 in 0.694s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:33 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf Aug 04 12:25:33 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:34 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Attempting download of 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume b540150d-748c-4b27-9903-80c3eee75eaf. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb27dd-3602-4ad3-8aaf-57c7547f3dfa]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:34 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi Aug 04 12:25:34 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:34 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi" returned: 0 in 0.442s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:34 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi Aug 04 12:25:34 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:35 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi" returned: 1 in 0.501s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8upp28hi' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72af23-c1a5-48a0-bbe4-cc6886bf3be7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:35 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD Aug 04 12:25:35 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:35 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD" returned: 0 in 0.492s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:25:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:35 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf Aug 04 12:25:35 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:37 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf" returned: 0 in 2.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:37 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_t3tuv8a8devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:25:37 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Converted 112.00 MB image at 49.28 MB/s Aug 04 12:25:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:37 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1G Aug 04 12:25:37 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:38 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf 1G" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Downloaded image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume b540150d-748c-4b27-9903-80c3eee75eaf successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 for user 790d046060a049baa5e81f852afef166 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Marking volume b540150d-748c-4b27-9903-80c3eee75eaf as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Copying metadata from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 to b540150d-748c-4b27-9903-80c3eee75eaf. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Creating volume glance metadata for volume b540150d-748c-4b27-9903-80c3eee75eaf backed by image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e953779-c660-40e8-bd3b-41b7e9780b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b540150d-748c-4b27-9903-80c3eee75eaf', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73793b5-187e-47fa-8917-0d3b945fdc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Volume volume-b540150d-748c-4b27-9903-80c3eee75eaf (b540150d-748c-4b27-9903-80c3eee75eaf): created successfully Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73793b5-187e-47fa-8917-0d3b945fdc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Flow 'volume_create_manager' (82c9ba68-3ce0-4c87-a0ef-1f7c3c3857f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-498c502d-fd32-42dc-afac-295a0177b7d6 tempest-VolumesImageMetadata-190985359 None] Created volume successfully. Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Acquiring lock "cinder-b540150d-748c-4b27-9903-80c3eee75eaf-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "cinder-b540150d-748c-4b27-9903-80c3eee75eaf-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Acquiring lock "cinder-quobyte-b540150d-748c-4b27-9903-80c3eee75eaf" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "cinder-quobyte-b540150d-748c-4b27-9903-80c3eee75eaf" acquired by "delete_volume" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[260fa4ad-5211-45cf-880f-8ccbb1f8085c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:40 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf Aug 04 12:25:40 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:41 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf" returned: 0 in 0.731s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:41 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf Aug 04 12:25:41 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:41 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b540150d-748c-4b27-9903-80c3eee75eaf" returned: 0 in 0.450s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "cinder-quobyte-b540150d-748c-4b27-9903-80c3eee75eaf" released by "delete_volume" :: held 1.310s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:41 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Created reservations ['da395526-19b5-4adc-ae63-004823fa0de2', '3edb14dc-804b-4f74-ab1f-790cc4fc2097', '2686489b-1386-4d5c-93eb-52bd0bff28e2', 'e36dbbd9-0990-4418-98b0-89292e93bfaa'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:42 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:42 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:42 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.438s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:42 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Deleted volume successfully. Aug 04 12:25:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-88a0e948-4e74-4486-9499-16ba834268f4 tempest-VolumesImageMetadata-190985359 None] Lock "cinder-b540150d-748c-4b27-9903-80c3eee75eaf-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=102,cinder:UPDATE=150,cinder:INSERT=34,cinder:DELETE=13 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=155,cinder:SELECT=123,cinder:INSERT=47,cinder:DELETE=9 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Flow 'volume_create_manager' (195aebd8-1d4b-4ef5-a0d6-e0cf1771a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc61f05-0a2c-49f4-9592-9be81a8b193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc61f05-0a2c-49f4-9592-9be81a8b193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1257829527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed43fa3-a649-4881-a5b5-9fdc206ca0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0545a03263864f41a04c3eb279bac03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:49Z,use_quota=True,user_id='6f5d7b3fd8064aee9db613e816cd4adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa42702a-d7ad-4907-95d8-e70c6fbbf783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa42702a-d7ad-4907-95d8-e70c6fbbf783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c95ca4-9a91-46c9-8e90-eb13bae91287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c95ca4-9a91-46c9-8e90-eb13bae91287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed43fa3-a649-4881-a5b5-9fdc206ca0cd', 'volume_name': 'volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b962e4-17f4-414c-bfbe-32caa2d01c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b962e4-17f4-414c-bfbe-32caa2d01c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f13929-9253-452f-a04c-3492305dc77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Volume 0ed43fa3-a649-4881-a5b5-9fdc206ca0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd', 'volume_size': 1} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1257829527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed43fa3-a649-4881-a5b5-9fdc206ca0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0545a03263864f41a04c3eb279bac03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:49Z,use_quota=True,user_id='6f5d7b3fd8064aee9db613e816cd4adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Creating volume 0ed43fa3-a649-4881-a5b5-9fdc206ca0cd {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:48 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:49 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd 1073741824 Aug 04 12:25:49 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:49 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd 1073741824" returned: 0 in 0.792s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:49 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd Aug 04 12:25:49 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:50 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" returned: 0 in 0.473s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f13929-9253-452f-a04c-3492305dc77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8376806d-934b-4266-b526-bcaed22b5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Flow 'volume_create_manager' (21d035e3-5dec-4eca-aed2-564af9259dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecf81de-1b3f-4aa3-9ac2-7fc567473aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecf81de-1b3f-4aa3-9ac2-7fc567473aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-725256259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60471ebb-ef7a-4366-8b00-4d5c6b6cdc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fa8f7b446486f896152f5b9460b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:50Z,use_quota=True,user_id='2b762bd0779344ff88cc4ca382290a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17acdd30-197c-48cf-9e73-7eeb99d39625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17acdd30-197c-48cf-9e73-7eeb99d39625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c86a15-9a95-4e21-a5ae-e5600cea0c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c86a15-9a95-4e21-a5ae-e5600cea0c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60471ebb-ef7a-4366-8b00-4d5c6b6cdc18', 'volume_name': 'volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef02e0-3ea8-4e23-ad15-5cb6fbc2dfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef02e0-3ea8-4e23-ad15-5cb6fbc2dfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c4f0b1-b992-4c24-bd81-81bd454bba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Volume 60471ebb-ef7a-4366-8b00-4d5c6b6cdc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18', 'volume_size': 1} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-725256259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60471ebb-ef7a-4366-8b00-4d5c6b6cdc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fa8f7b446486f896152f5b9460b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:50Z,use_quota=True,user_id='2b762bd0779344ff88cc4ca382290a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Creating volume 60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Volume volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd (0ed43fa3-a649-4881-a5b5-9fdc206ca0cd): created successfully Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8376806d-934b-4266-b526-bcaed22b5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Flow 'volume_create_manager' (195aebd8-1d4b-4ef5-a0d6-e0cf1771a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:50 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 1073741824 Aug 04 12:25:50 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-69ad1e4b-d7e3-401b-835a-293f5a484388 tempest-VolumesMetadataTest-1322385985 None] Created volume successfully. Aug 04 12:25:51 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 1073741824" returned: 0 in 0.645s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:51 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 Aug 04 12:25:51 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:51 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" returned: 0 in 0.487s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c4f0b1-b992-4c24-bd81-81bd454bba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc9cb1b-533f-44b5-ae69-98be18b633a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Volume volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 (60471ebb-ef7a-4366-8b00-4d5c6b6cdc18): created successfully Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc9cb1b-533f-44b5-ae69-98be18b633a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Flow 'volume_create_manager' (21d035e3-5dec-4eca-aed2-564af9259dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f0b80dbd-bc92-4ad6-bb18-523b1dbe8c8b tempest-AbsoluteLimitsTests-1186714163 None] Created volume successfully. Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Acquiring lock "cinder-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "cinder-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Acquiring lock "cinder-quobyte-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "cinder-quobyte-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a89b78-3409-4e52-b17a-f5d526ed3875]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:52 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd Aug 04 12:25:52 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Acquiring lock "cinder-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "cinder-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Acquiring lock "cinder-quobyte-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "cinder-quobyte-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0d1ce-3239-4477-99b6-2dd2e0ea1595]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:52 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" returned: 0 in 0.572s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:52 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd Aug 04 12:25:52 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:52 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 Aug 04 12:25:52 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:53 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" returned: 0 in 0.381s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "cinder-quobyte-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd" released by "delete_volume" :: held 1.008s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:53 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" returned: 0 in 0.525s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Created reservations ['12456061-02ec-43ce-89a6-c3e4d2c31cbf', '6e321b2a-d089-4374-bdf4-68bb142ed7ce', 'bbc267cf-cf7b-42f9-acde-bf351611051d', '44788fff-7b68-444e-903b-20524d982714'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:53 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18 Aug 04 12:25:53 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:53 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:53 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:53 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" returned: 0 in 0.430s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "cinder-quobyte-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18" released by "delete_volume" :: held 1.014s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:53 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.327s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Deleted volume successfully. Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Created reservations ['46c086a7-3179-44fc-a5af-87ce8c92ec2b', 'ddc2b776-3fa4-4f6b-b64f-f0a6ec835e92', 'b81d4931-0d1d-4814-85e9-3b64a6c28122', '42942233-324f-4aff-8757-8b1e68eca3ce'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be9887c4-a6e7-40da-9c42-eb1455d3a5fc tempest-VolumesMetadataTest-1322385985 None] Lock "cinder-0ed43fa3-a649-4881-a5b5-9fdc206ca0cd-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:53 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:25:53 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:54 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:54 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:25:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Deleted volume successfully. Aug 04 12:25:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d0afdd7b-c97e-49e3-8f93-12902ff29a52 tempest-AbsoluteLimitsTests-1186714163 None] Lock "cinder-60471ebb-ef7a-4366-8b00-4d5c6b6cdc18-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:25:57 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (25aa6a9c-b50c-4e8b-a508-41f8bca8197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd79bbc8-403f-4926-b5b2-51197ab1a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd79bbc8-403f-4926-b5b2-51197ab1a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1245943707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1b47fb-f87a-4da6-8121-d7e320f7cbba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:58Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba4d3b2-bcee-456f-9e1c-b0f4af3ad598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba4d3b2-bcee-456f-9e1c-b0f4af3ad598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798dd83d-7469-444b-a1f0-e3c9311e3a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798dd83d-7469-444b-a1f0-e3c9311e3a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1b47fb-f87a-4da6-8121-d7e320f7cbba', 'volume_name': 'volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b767d9-6487-428f-b8e0-0394739e7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b767d9-6487-428f-b8e0-0394739e7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53661b6-e6b4-47fb-93a4-bc5551c8af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Volume ca1b47fb-f87a-4da6-8121-d7e320f7cbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba', 'volume_size': 1} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1245943707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1b47fb-f87a-4da6-8121-d7e320f7cbba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:25:58Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Creating volume ca1b47fb-f87a-4da6-8121-d7e320f7cbba {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:25:58 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:58 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba 1073741824 Aug 04 12:25:58 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:58 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba 1073741824" returned: 0 in 0.671s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:25:58 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba Aug 04 12:25:58 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:25:59 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" returned: 0 in 0.276s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53661b6-e6b4-47fb-93a4-bc5551c8af74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8755a99d-d53a-438f-8215-162a91259b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:25:59 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Volume volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba (ca1b47fb-f87a-4da6-8121-d7e320f7cbba): created successfully Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8755a99d-d53a-438f-8215-162a91259b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:25:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (25aa6a9c-b50c-4e8b-a508-41f8bca8197d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:25:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3c8356ad-7567-4546-b2d2-fb79a25ee177 tempest-VolumesListTestJSON-978716449 None] Created volume successfully. Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (bc410370-ea86-4517-b3ea-d5e1d7ff1311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a9c345-e9cf-41fd-a5d0-c4529c421a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a9c345-e9cf-41fd-a5d0-c4529c421a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2102639539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c6a02f-7765-4a0b-826f-bcdafa2be90f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:01Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3b578f-3cf5-453f-9601-e9d2967cdcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3b578f-3cf5-453f-9601-e9d2967cdcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19905d2-64df-4e68-9088-8798aec7e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19905d2-64df-4e68-9088-8798aec7e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c6a02f-7765-4a0b-826f-bcdafa2be90f', 'volume_name': 'volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824b0bf-9d5d-4435-ab22-a6155109c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824b0bf-9d5d-4435-ab22-a6155109c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0741713a-7433-4a87-a1bf-3aa3be7c2aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Volume d1c6a02f-7765-4a0b-826f-bcdafa2be90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f', 'volume_size': 1} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2102639539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c6a02f-7765-4a0b-826f-bcdafa2be90f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:01Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Creating volume d1c6a02f-7765-4a0b-826f-bcdafa2be90f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:00 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:01 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f 1073741824 Aug 04 12:26:01 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:01 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f 1073741824" returned: 0 in 0.680s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:01 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f Aug 04 12:26:01 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:02 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" returned: 0 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0741713a-7433-4a87-a1bf-3aa3be7c2aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478c740b-ed2d-4f7b-8c1c-85750141ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:02 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Volume volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f (d1c6a02f-7765-4a0b-826f-bcdafa2be90f): created successfully Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478c740b-ed2d-4f7b-8c1c-85750141ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (bc410370-ea86-4517-b3ea-d5e1d7ff1311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9756f0c2-012a-48e7-9d43-289372392154 tempest-VolumesListTestJSON-978716449 None] Created volume successfully. Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Flow 'volume_create_manager' (35d252d7-dfa6-4aff-b8be-bd16c9605022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cce94-26c2-49d5-ac7a-d039b99d9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cce94-26c2-49d5-ac7a-d039b99d9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-670433631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafe0de-ad5c-4028-8a2d-67009f814770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e171e850345eabd193ac0ae2ecee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:03Z,use_quota=True,user_id='6b8f1e22a34f4f72ab5a99827cac94ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d1811d-308b-4b8d-8dd5-09602e694d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d1811d-308b-4b8d-8dd5-09602e694d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e91f7c9-bde4-46aa-b7c4-c7663e2aa8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e91f7c9-bde4-46aa-b7c4-c7663e2aa8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faafe0de-ad5c-4028-8a2d-67009f814770', 'volume_name': 'volume-faafe0de-ad5c-4028-8a2d-67009f814770', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29598558-1a5d-4f11-8950-37446b38c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29598558-1a5d-4f11-8950-37446b38c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d8506b-acab-49a3-bce5-5c5e95ce2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:03 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Volume faafe0de-ad5c-4028-8a2d-67009f814770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faafe0de-ad5c-4028-8a2d-67009f814770', 'volume_size': 1} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-670433631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafe0de-ad5c-4028-8a2d-67009f814770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e171e850345eabd193ac0ae2ecee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:03Z,use_quota=True,user_id='6b8f1e22a34f4f72ab5a99827cac94ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Creating volume faafe0de-ad5c-4028-8a2d-67009f814770 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:03 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:03 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 1073741824 Aug 04 12:26:03 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:03 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 1073741824" returned: 0 in 0.625s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (00b6b7eb-cdbc-458c-8317-2f2a90c8e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3f6558-030a-4f5e-a805-941062e30453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3f6558-030a-4f5e-a805-941062e30453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-309706617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a58d5e-aaf3-44ee-be52-7eb1012ef17d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:04Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0217b27-210f-4f67-815d-9395b68536f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0217b27-210f-4f67-815d-9395b68536f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 Aug 04 12:26:04 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4177d38a-c11f-418d-9853-84e0b74cdf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4177d38a-c11f-418d-9853-84e0b74cdf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a58d5e-aaf3-44ee-be52-7eb1012ef17d', 'volume_name': 'volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af841a7-7fe6-41e2-8065-6c89dedbbde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af841a7-7fe6-41e2-8065-6c89dedbbde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6db5ba1-b215-4509-a549-0f39c10e11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Volume 90a58d5e-aaf3-44ee-be52-7eb1012ef17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d', 'volume_size': 1} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:04 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770" returned: 0 in 0.270s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-309706617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a58d5e-aaf3-44ee-be52-7eb1012ef17d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525a29d3e22c491dacbe8a20148e247d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:04Z,use_quota=True,user_id='da075df6a1164a63b1b72f0b13f74a48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Creating volume 90a58d5e-aaf3-44ee-be52-7eb1012ef17d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:04 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d8506b-acab-49a3-bce5-5c5e95ce2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faafe0de-ad5c-4028-8a2d-67009f814770', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccede976-08ce-4c21-a916-ab48a814853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:04 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d 1073741824 Aug 04 12:26:04 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Volume volume-faafe0de-ad5c-4028-8a2d-67009f814770 (faafe0de-ad5c-4028-8a2d-67009f814770): created successfully Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccede976-08ce-4c21-a916-ab48a814853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Flow 'volume_create_manager' (35d252d7-dfa6-4aff-b8be-bd16c9605022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-223423fb-0f45-4f1f-b932-c72e80b1fd5a tempest-VolumesTransfersTest-670152585 None] Created volume successfully. Aug 04 12:26:04 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d 1073741824" returned: 0 in 0.511s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:05 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d Aug 04 12:26:05 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:05 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" returned: 0 in 0.269s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6db5ba1-b215-4509-a549-0f39c10e11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6597f561-0af9-4147-8d49-8a91672a2d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Volume volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d (90a58d5e-aaf3-44ee-be52-7eb1012ef17d): created successfully Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6597f561-0af9-4147-8d49-8a91672a2d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Flow 'volume_create_manager' (00b6b7eb-cdbc-458c-8317-2f2a90c8e683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-53e061bc-62f9-4754-8903-846f5f63921f tempest-VolumesListTestJSON-978716449 None] Created volume successfully. Aug 04 12:26:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0e55492d-9007-4a77-96a2-4bebc905c699 tempest-VolumesTransfersTest-1799618511 None] Transfer volume completed successfully. Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:06 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:06 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:06 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.352s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "cinder-faafe0de-ad5c-4028-8a2d-67009f814770-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-faafe0de-ad5c-4028-8a2d-67009f814770-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "cinder-quobyte-faafe0de-ad5c-4028-8a2d-67009f814770" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-quobyte-faafe0de-ad5c-4028-8a2d-67009f814770" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c27e5-dfb9-4ffd-b25e-fa1b36b9272a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:06 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 Aug 04 12:26:06 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:07 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770" returned: 0 in 0.698s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:07 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770 Aug 04 12:26:07 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:07 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-faafe0de-ad5c-4028-8a2d-67009f814770" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-quobyte-faafe0de-ad5c-4028-8a2d-67009f814770" released by "delete_volume" :: held 1.087s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Created reservations ['517aec91-b444-4b3d-90f1-856f4a26cc03', 'd61985c9-83e9-4f78-a380-163b8fbf278b', '22cdfbcd-91f1-4d12-8603-673301f28e2f', '3152cd91-3d8e-41e8-8d83-38a3db93ca3f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:08 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:08 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:08 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.393s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Deleted volume successfully. Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dec50d33-8ccf-4e4d-95a0-f042d53eac44 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-faafe0de-ad5c-4028-8a2d-67009f814770-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (fdf9d37f-156d-4c42-9ef7-b9ff0ec4f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3b8bec-ff79-4d9a-aa8a-1ecdd04241c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3b8bec-ff79-4d9a-aa8a-1ecdd04241c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2033476883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93648ff1-7862-4ab1-a3ce-cc4b95e29f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:08Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffdf4fa-d2d0-4b8b-af20-7132be89731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffdf4fa-d2d0-4b8b-af20-7132be89731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300d8460-92c6-44c0-b317-e9adaeb5a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300d8460-92c6-44c0-b317-e9adaeb5a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93648ff1-7862-4ab1-a3ce-cc4b95e29f93', 'volume_name': 'volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ad5eac-98de-4153-9166-7ae447dd349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ad5eac-98de-4153-9166-7ae447dd349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd590f-4a8d-4aa5-8cc0-268c5122e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:08 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Volume 93648ff1-7862-4ab1-a3ce-cc4b95e29f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93', 'volume_size': 1} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2033476883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93648ff1-7862-4ab1-a3ce-cc4b95e29f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:08Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Creating volume 93648ff1-7862-4ab1-a3ce-cc4b95e29f93 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:08 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-90a58d5e-aaf3-44ee-be52-7eb1012ef17d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:08 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 1073741824 Aug 04 12:26:08 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-90a58d5e-aaf3-44ee-be52-7eb1012ef17d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-quobyte-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83ffb5b-91c0-4131-bcbd-13e54ab9756c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:09 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d Aug 04 12:26:09 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:09 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 1073741824" returned: 0 in 0.618s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:09 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" returned: 0 in 0.571s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:09 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d Aug 04 12:26:09 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:09 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 Aug 04 12:26:09 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Flow 'volume_create_manager' (b2fbadd5-57fa-49b8-9be0-5663190c53bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786c0dfd-3745-4103-ac87-96358dbb72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:09 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" returned: 0 in 0.515s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-90a58d5e-aaf3-44ee-be52-7eb1012ef17d" released by "delete_volume" :: held 1.196s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786c0dfd-3745-4103-ac87-96358dbb72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1626821584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf90c8c-16e5-41ad-997d-f7452cb9bcd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e171e850345eabd193ac0ae2ecee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:10Z,use_quota=True,user_id='6b8f1e22a34f4f72ab5a99827cac94ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff3937d-3972-4827-af77-7fad331e0387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff3937d-3972-4827-af77-7fad331e0387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3236e9fc-2dc5-45c9-b08b-89c04c91dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3236e9fc-2dc5-45c9-b08b-89c04c91dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf90c8c-16e5-41ad-997d-f7452cb9bcd3', 'volume_name': 'volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cf2c5c-4916-414b-895a-42bdbcc69512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cf2c5c-4916-414b-895a-42bdbcc69512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54d043b-4cdd-47d3-b37f-40526c2f91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:10 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Volume edf90c8c-16e5-41ad-997d-f7452cb9bcd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3', 'volume_size': 1} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Created reservations ['84404c2d-dd6a-4a14-92ef-9f63efcf2cab', '96430fde-d02e-4b2c-a105-93bacb04264b', 'ccff21b3-a8ba-4b1e-a62a-4049252ab3e4', '081e6252-acdd-47b0-b5d0-a6373fd9deb4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:10 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" returned: 0 in 0.694s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1626821584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf90c8c-16e5-41ad-997d-f7452cb9bcd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612e171e850345eabd193ac0ae2ecee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:10Z,use_quota=True,user_id='6b8f1e22a34f4f72ab5a99827cac94ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Creating volume edf90c8c-16e5-41ad-997d-f7452cb9bcd3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:10 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd590f-4a8d-4aa5-8cc0-268c5122e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 1073741824 Aug 04 12:26:10 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c4fc4-e25d-411b-93f9-bd9122b921b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:10 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Volume volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 (93648ff1-7862-4ab1-a3ce-cc4b95e29f93): created successfully Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c4fc4-e25d-411b-93f9-bd9122b921b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (fdf9d37f-156d-4c42-9ef7-b9ff0ec4f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5a6b13db-d003-4e26-b68d-db468cc97ee6 tempest-AttachVolumeNegativeTest-22382868 None] Created volume successfully. Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:10 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:10 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:10 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Deleted volume successfully. Aug 04 12:26:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-02c57b07-8cf0-4247-a567-02840057b3a5 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-90a58d5e-aaf3-44ee-be52-7eb1012ef17d-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:11 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 1073741824" returned: 0 in 0.863s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:11 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-d1c6a02f-7765-4a0b-826f-bcdafa2be90f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:11 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-d1c6a02f-7765-4a0b-826f-bcdafa2be90f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-quobyte-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eab132-45df-46c8-a9e9-bf3f5be7930b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:11 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" returned: 0 in 0.393s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:11 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f Aug 04 12:26:11 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54d043b-4cdd-47d3-b37f-40526c2f91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c892ecd4-2afe-474d-b2b0-c30dd520be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:11 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Volume volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 (edf90c8c-16e5-41ad-997d-f7452cb9bcd3): created successfully Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c892ecd4-2afe-474d-b2b0-c30dd520be44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Flow 'volume_create_manager' (b2fbadd5-57fa-49b8-9be0-5663190c53bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4cf348fb-6614-4242-a021-753bb51b8e1c tempest-VolumesTransfersTest-670152585 None] Created volume successfully. Aug 04 12:26:11 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" returned: 0 in 0.624s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:12 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f Aug 04 12:26:12 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b4b47e7a-2322-4eb5-a53c-2b5602befd46 req-cdd9c668-8f34-49c9-a627-d000f49e3065 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b4b47e7a-2322-4eb5-a53c-2b5602befd46 req-cdd9c668-8f34-49c9-a627-d000f49e3065 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-b4b47e7a-2322-4eb5-a53c-2b5602befd46 req-cdd9c668-8f34-49c9-a627-d000f49e3065 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-b4b47e7a-2322-4eb5-a53c-2b5602befd46 req-cdd9c668-8f34-49c9-a627-d000f49e3065 tempest-AttachVolumeNegativeTest-22382868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09e20801-25ad-413c-bdc7-e1feb9568928', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:26:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-b4b47e7a-2322-4eb5-a53c-2b5602befd46 req-cdd9c668-8f34-49c9-a627-d000f49e3065 tempest-AttachVolumeNegativeTest-22382868 None] attachment_update completed successfully. Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "cinder-edf90c8c-16e5-41ad-997d-f7452cb9bcd3-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-edf90c8c-16e5-41ad-997d-f7452cb9bcd3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:12 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" returned: 0 in 0.402s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-d1c6a02f-7765-4a0b-826f-bcdafa2be90f" released by "delete_volume" :: held 1.139s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "cinder-quobyte-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-quobyte-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7005cf-ecd7-48ad-82e5-60af21be0766]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Created reservations ['71876e4d-9022-4c41-9040-6d331972f565', 'bbc70a40-4b03-4918-ace5-ad8701c2c92d', 'e89559d4-3a7e-4918-a65b-d1a33c9e027b', 'ce1f1b13-b7a0-4988-8b44-4f938ab64016'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:12 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 Aug 04 12:26:12 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:12 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:12 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:13 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.382s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:13 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Deleted volume successfully. Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" returned: 0 in 0.659s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:13 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3 Aug 04 12:26:13 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6ccc7ed-153e-444f-a974-8b0cee9a88f8 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-d1c6a02f-7765-4a0b-826f-bcdafa2be90f-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:13 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-quobyte-edf90c8c-16e5-41ad-997d-f7452cb9bcd3" released by "delete_volume" :: held 1.072s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Created reservations ['e6d72a9c-cb1a-457c-98c0-e8225d1e21f5', '339b91f0-0b30-4372-8996-41e4d202b173', '0ef1af96-5a80-40af-aadc-4aa3501f2e07', 'a25b185e-1311-4da4-81cf-a5992bb1fa87'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-ca1b47fb-f87a-4da6-8121-d7e320f7cbba-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-ca1b47fb-f87a-4da6-8121-d7e320f7cbba-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "cinder-quobyte-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" acquired by "delete_volume" :: waited 0.058s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:13 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:13 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e339c-67f0-44b3-9c95-2174440baebb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:14 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba Aug 04 12:26:14 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:14 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.420s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Deleted volume successfully. Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-642f717c-47cb-453a-80a3-b99714012d26 tempest-VolumesTransfersTest-1841352266 None] Lock "cinder-edf90c8c-16e5-41ad-997d-f7452cb9bcd3-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:14 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" returned: 0 in 0.588s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:14 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba Aug 04 12:26:14 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:14 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" returned: 0 in 0.490s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-quobyte-ca1b47fb-f87a-4da6-8121-d7e320f7cbba" released by "delete_volume" :: held 1.175s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Created reservations ['d87a946f-475d-46c3-9716-c0204d890379', '856d027b-4e3a-4f76-ad01-4c4776ba648b', '9a13e30e-1394-4452-b7a6-b2a3b31535d3', '9d5cba64-2070-43d4-8d36-423962bf3341'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:15 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:15 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:15 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.598s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Deleted volume successfully. Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e5fdf695-5f72-4540-9043-4c3b7c6c3125 tempest-VolumesListTestJSON-978716449 None] Lock "cinder-ca1b47fb-f87a-4da6-8121-d7e320f7cbba-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (6232776e-d47f-4202-93e6-b3a29f1407d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ccef25-a46d-40ef-8a85-ca6fd1bb1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ccef25-a46d-40ef-8a85-ca6fd1bb1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500457876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b55fa4-c91f-4724-9364-d2fe8371fd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:16Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344ad72-9fc4-4b76-a818-91cfaa1016ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344ad72-9fc4-4b76-a818-91cfaa1016ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab5128-3d0c-4c25-b59f-05566bd6665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab5128-3d0c-4c25-b59f-05566bd6665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b55fa4-c91f-4724-9364-d2fe8371fd8d', 'volume_name': 'volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b778d88-d32d-4959-b077-db9c0f260000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b778d88-d32d-4959-b077-db9c0f260000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87076d-07cd-4b4a-ba3f-fe94c05eb3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Volume b5b55fa4-c91f-4724-9364-d2fe8371fd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d', 'volume_size': 1} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1500457876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b55fa4-c91f-4724-9364-d2fe8371fd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:16Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Creating volume b5b55fa4-c91f-4724-9364-d2fe8371fd8d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:16 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:16 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d 1073741824 Aug 04 12:26:16 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:16 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d 1073741824" returned: 0 in 0.695s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:17 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d Aug 04 12:26:17 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:17 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87076d-07cd-4b4a-ba3f-fe94c05eb3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87817f-fd3d-40c0-9b5c-686ffb6cf34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Volume volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d (b5b55fa4-c91f-4724-9364-d2fe8371fd8d): created successfully Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87817f-fd3d-40c0-9b5c-686ffb6cf34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (6232776e-d47f-4202-93e6-b3a29f1407d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6886585f-f918-4a6f-8796-0a1da8133f79 tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6d7fd6f3-78e0-45f2-9ebf-0ecf52206711 tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" by "attach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6d7fd6f3-78e0-45f2-9ebf-0ecf52206711 tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" acquired by "attach_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6d7fd6f3-78e0-45f2-9ebf-0ecf52206711 tempest-VolumesActionsTest-392532842 None] Attaching volume b5b55fa4-c91f-4724-9364-d2fe8371fd8d to instance f7531e2c-d773-463a-91b1-bb3efb9effc5 at mountpoint /dev/vdb on host None. Aug 04 12:26:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6d7fd6f3-78e0-45f2-9ebf-0ecf52206711 tempest-VolumesActionsTest-392532842 None] Attach volume completed successfully. Aug 04 12:26:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6d7fd6f3-78e0-45f2-9ebf-0ecf52206711 tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" released by "attach_volume" :: held 0.169s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Terminate volume connection completed successfully. Aug 04 12:26:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" by "detach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Detaching volume b5b55fa4-c91f-4724-9364-d2fe8371fd8d from instance f7531e2c-d773-463a-91b1-bb3efb9effc5. Aug 04 12:26:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Detach volume completed successfully. Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-732d7906-cec0-42a3-a34a-dc1b26ab3d48 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ec6bfcc-e019-41c3-aa37-f764f57907aa tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" by "detach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ec6bfcc-e019-41c3-aa37-f764f57907aa tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7ec6bfcc-e019-41c3-aa37-f764f57907aa tempest-VolumesActionsTest-392532842 None] Volume detach called, but volume not attached. Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ec6bfcc-e019-41c3-aa37-f764f57907aa tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-quobyte-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "cinder-quobyte-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" acquired by "delete_volume" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3972e59-d81e-4aed-8da6-bb1a7d8e3392]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:21 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d Aug 04 12:26:21 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:21 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" returned: 0 in 0.938s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:21 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d Aug 04 12:26:21 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:22 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" returned: 0 in 0.606s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "cinder-quobyte-b5b55fa4-c91f-4724-9364-d2fe8371fd8d" released by "delete_volume" :: held 1.627s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Created reservations ['69d8d265-3e6b-4061-b2b1-66e3763a61ef', 'dd6e86f5-07a9-4da1-8eac-22b77bd11dda', 'fbd90495-4018-4657-a98c-aa4482676ef7', '1d1d3c0e-60bb-486e-bbea-c8ac921962cb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:22 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:22 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:23 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.487s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:23 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Deleted volume successfully. Aug 04 12:26:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7403b6dc-e47a-4008-b38f-f348ecbe8775 tempest-VolumesActionsTest-392532842 None] Lock "cinder-b5b55fa4-c91f-4724-9364-d2fe8371fd8d-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (a3027419-cbd6-4a73-8f5f-7fa6167f3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6455664-31ca-4017-8fd0-e19f8159cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6455664-31ca-4017-8fd0-e19f8159cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237682287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cf2ac6-ae52-4418-add2-da8fab0497de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:29Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfb1a3e-43f0-45d7-9db3-06c521163e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfb1a3e-43f0-45d7-9db3-06c521163e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7b612-6cd1-4d84-ba22-3d2a59d6a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7b612-6cd1-4d84-ba22-3d2a59d6a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cf2ac6-ae52-4418-add2-da8fab0497de', 'volume_name': 'volume-49cf2ac6-ae52-4418-add2-da8fab0497de', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83cfc5-b98b-4d4f-8128-1faac018cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca83cfc5-b98b-4d4f-8128-1faac018cbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b44634-35af-4e2c-a9bf-c55b6d0842c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Volume 49cf2ac6-ae52-4418-add2-da8fab0497de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cf2ac6-ae52-4418-add2-da8fab0497de', 'volume_size': 1} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1237682287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cf2ac6-ae52-4418-add2-da8fab0497de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:29Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Creating volume 49cf2ac6-ae52-4418-add2-da8fab0497de {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:29 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:29 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de 1073741824 Aug 04 12:26:29 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:30 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de 1073741824" returned: 0 in 0.555s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:30 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de Aug 04 12:26:30 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:30 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de" returned: 0 in 0.288s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b44634-35af-4e2c-a9bf-c55b6d0842c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cf2ac6-ae52-4418-add2-da8fab0497de', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289673de-e46b-44e7-a873-b25ce69e4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:30 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Volume volume-49cf2ac6-ae52-4418-add2-da8fab0497de (49cf2ac6-ae52-4418-add2-da8fab0497de): created successfully Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289673de-e46b-44e7-a873-b25ce69e4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (a3027419-cbd6-4a73-8f5f-7fa6167f3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e22018ca-cae4-46ed-a6fa-55218b1e8e7c tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-49cf2ac6-ae52-4418-add2-da8fab0497de-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "cinder-49cf2ac6-ae52-4418-add2-da8fab0497de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-quobyte-49cf2ac6-ae52-4418-add2-da8fab0497de" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-49cf2ac6-ae52-4418-add2-da8fab0497de" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86ffed-6b8d-42ff-ab72-576805257970]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:31 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de Aug 04 12:26:31 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:32 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de" returned: 0 in 0.450s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:32 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de Aug 04 12:26:32 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:32 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49cf2ac6-ae52-4418-add2-da8fab0497de" returned: 0 in 0.306s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-49cf2ac6-ae52-4418-add2-da8fab0497de" released by "delete_volume" :: held 0.810s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Created reservations ['f3ac1da9-f645-466a-b823-6986a22dd6bc', 'eb15c5c3-9feb-45ca-8070-29dab7961368', 'a412c235-de95-4f40-80c7-3b14fe147ac9', '87d7c084-ab8b-4e62-8342-4d674dd49b39'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:32 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:32 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:33 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Deleted volume successfully. Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-63844d18-0a88-4829-9471-43b9933f329e tempest-VolumesActionsTest-2129872426 None] Lock "cinder-49cf2ac6-ae52-4418-add2-da8fab0497de-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (fb66ab08-767b-4d86-a40b-4dd50050502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daea7c5c-a697-4fa1-a079-83519fb88d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daea7c5c-a697-4fa1-a079-83519fb88d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490622400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e1335c-5928-49fa-b284-c62824d16aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:33Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9656ca91-5755-4ed0-840c-e13803ceb487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9656ca91-5755-4ed0-840c-e13803ceb487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff1c148-2d78-4c59-9aa3-872e27637fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff1c148-2d78-4c59-9aa3-872e27637fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e1335c-5928-49fa-b284-c62824d16aa4', 'volume_name': 'volume-24e1335c-5928-49fa-b284-c62824d16aa4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4799e9-808f-4a20-b940-ea9c8f0e1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4799e9-808f-4a20-b940-ea9c8f0e1d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4b3037-9d17-472b-a6b3-3634d7f57750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Volume 24e1335c-5928-49fa-b284-c62824d16aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e1335c-5928-49fa-b284-c62824d16aa4', 'volume_size': 1} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490622400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e1335c-5928-49fa-b284-c62824d16aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:33Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Creating volume 24e1335c-5928-49fa-b284-c62824d16aa4 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:33 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:33 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 1073741824 Aug 04 12:26:33 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:34 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 1073741824" returned: 0 in 0.587s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:34 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 Aug 04 12:26:34 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:34 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4b3037-9d17-472b-a6b3-3634d7f57750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e1335c-5928-49fa-b284-c62824d16aa4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19fa75c-f1e0-44fe-8914-82cd81f34f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:34 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Volume volume-24e1335c-5928-49fa-b284-c62824d16aa4 (24e1335c-5928-49fa-b284-c62824d16aa4): created successfully Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19fa75c-f1e0-44fe-8914-82cd81f34f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (fb66ab08-767b-4d86-a40b-4dd50050502a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-971cbfb3-954f-423b-977e-6a4d22426b56 tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-24e1335c-5928-49fa-b284-c62824d16aa4-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "cinder-24e1335c-5928-49fa-b284-c62824d16aa4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-quobyte-24e1335c-5928-49fa-b284-c62824d16aa4" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-24e1335c-5928-49fa-b284-c62824d16aa4" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7dd536-373d-4507-9558-fa95c91b4ae4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:36 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 Aug 04 12:26:36 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:36 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4" returned: 0 in 0.395s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:36 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4 Aug 04 12:26:36 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:36 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-24e1335c-5928-49fa-b284-c62824d16aa4" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-24e1335c-5928-49fa-b284-c62824d16aa4" released by "delete_volume" :: held 0.824s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Created reservations ['6162f920-cb2d-4544-8635-216dcca07c68', '5cdcacd7-d0fd-47c1-af04-6cc3ef96f1fa', '41e12188-0734-4584-9c31-7ef47f1a8114', '112c0db7-8a3b-4551-8a53-4910ac309700'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:36 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:36 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:37 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.436s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:37 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Deleted volume successfully. Aug 04 12:26:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bd358240-fa63-4e1d-8b7a-92ed9f18b67f tempest-VolumesActionsTest-2129872426 None] Lock "cinder-24e1335c-5928-49fa-b284-c62824d16aa4-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (e354b119-a1a2-4a34-bde2-18c1b652e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdc0af5-9642-4b1a-95fb-83bfc7887978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdc0af5-9642-4b1a-95fb-83bfc7887978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1251302214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:38Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8a9e6d-26e1-4fa3-ab20-b55882f6a851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8a9e6d-26e1-4fa3-ab20-b55882f6a851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0de0988-86d2-46a8-8d3a-c82199c31c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0de0988-86d2-46a8-8d3a-c82199c31c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b', 'volume_name': 'volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be69d70d-ae80-4f2f-b0b0-b9334f12a467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be69d70d-ae80-4f2f-b0b0-b9334f12a467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a903ab-2279-4b8b-a9c3-2fd9208b86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Volume 2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b', 'volume_size': 1} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1251302214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:38Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Creating volume 2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:38 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:38 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b 1073741824 Aug 04 12:26:38 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (66dc1b54-bdd1-4283-a89e-fbae32044b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68fb6a-964f-4a49-a47e-19146c91a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68fb6a-964f-4a49-a47e-19146c91a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200954207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f7d119-5586-448a-a0d6-baa2eb902552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:38Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9176c9b8-8d03-400e-bf9c-2310ededf343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9176c9b8-8d03-400e-bf9c-2310ededf343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fcc7b3-6260-4ea0-b44f-045846beed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fcc7b3-6260-4ea0-b44f-045846beed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f7d119-5586-448a-a0d6-baa2eb902552', 'volume_name': 'volume-d5f7d119-5586-448a-a0d6-baa2eb902552', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d95c79f-a32e-41a4-bab6-3598e232e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d95c79f-a32e-41a4-bab6-3598e232e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0190bc5-bdcb-42ca-ac7d-dbbdecf2be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Volume d5f7d119-5586-448a-a0d6-baa2eb902552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f7d119-5586-448a-a0d6-baa2eb902552', 'volume_size': 1} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Flow 'volume_create_manager' (e8cd805a-9d8a-4348-990d-83d8822d85a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3b4f5-fca7-4679-adac-8416d3c0fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3b4f5-fca7-4679-adac-8416d3c0fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461926700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78f711-a5e4-4c1d-a429-0f3fb8c38272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80945132f4a429fb91afb666bbf9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:39Z,use_quota=True,user_id='db706f1a96a948fead09afe3397696e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f86b23-2e20-4be4-ad89-9b101751a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f86b23-2e20-4be4-ad89-9b101751a00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d002c9f-690c-4536-b233-b4a86bc99db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d002c9f-690c-4536-b233-b4a86bc99db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae78f711-a5e4-4c1d-a429-0f3fb8c38272', 'volume_name': 'volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2414f82c-58ac-4a2c-bac4-27744156b48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2414f82c-58ac-4a2c-bac4-27744156b48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1286d7d2-3ae7-4fe6-a083-ae95a1b448ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272', 'volume_size': 1} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:39 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b 1073741824" returned: 0 in 0.817s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:39 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b Aug 04 12:26:39 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:39 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" returned: 0 in 0.387s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200954207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f7d119-5586-448a-a0d6-baa2eb902552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:38Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Creating volume d5f7d119-5586-448a-a0d6-baa2eb902552 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:39 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a903ab-2279-4b8b-a9c3-2fd9208b86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70beff12-2d50-4225-9c4d-7b0b2104f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:39 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 1073741824 Aug 04 12:26:39 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Volume volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b (2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b): created successfully Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70beff12-2d50-4225-9c4d-7b0b2104f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (e354b119-a1a2-4a34-bde2-18c1b652e848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-91269d19-49b7-4df7-bf64-90645babdedb tempest-VolumesSnapshotTestJSON-621798158 None] Created volume successfully. Aug 04 12:26:40 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 1073741824" returned: 0 in 0.920s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:40 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 Aug 04 12:26:40 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:40 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552" returned: 0 in 0.399s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461926700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78f711-a5e4-4c1d-a429-0f3fb8c38272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80945132f4a429fb91afb666bbf9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:39Z,use_quota=True,user_id='db706f1a96a948fead09afe3397696e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Creating volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:40 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0190bc5-bdcb-42ca-ac7d-dbbdecf2be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f7d119-5586-448a-a0d6-baa2eb902552', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:41 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 1073741824 Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae347ab-d900-4d57-b71f-8c7dcf7ef0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:41 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Volume volume-d5f7d119-5586-448a-a0d6-baa2eb902552 (d5f7d119-5586-448a-a0d6-baa2eb902552): created successfully Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae347ab-d900-4d57-b71f-8c7dcf7ef0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (66dc1b54-bdd1-4283-a89e-fbae32044b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bba6719a-3b87-4f72-9a11-2f77965049bd tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-d5f7d119-5586-448a-a0d6-baa2eb902552-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-d5f7d119-5586-448a-a0d6-baa2eb902552-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-quobyte-d5f7d119-5586-448a-a0d6-baa2eb902552" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-d5f7d119-5586-448a-a0d6-baa2eb902552" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d2b9c-deaa-4d4f-8393-3e9418b4023f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:41 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 1073741824" returned: 0 in 0.711s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:41 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 Aug 04 12:26:41 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:41 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:26:41 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:42 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552" returned: 0 in 0.427s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:42 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552 Aug 04 12:26:42 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:42 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.291s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.532s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1286d7d2-3ae7-4fe6-a083-ae95a1b448ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43b7cc-39ab-4d3e-8787-34ff3a288cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Creating offline snapshot 3d7785d2-6191-413f-a997-bddbb59bb26d of volume 2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:26:42 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Volume volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 (ae78f711-a5e4-4c1d-a429-0f3fb8c38272): created successfully Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43b7cc-39ab-4d3e-8787-34ff3a288cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Flow 'volume_create_manager' (e8cd805a-9d8a-4348-990d-83d8822d85a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf47e2b-bfb9-4153-b89d-31b07437e30d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:42 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-69b307d8-8c8a-41b3-9aaa-a04934aae3cc tempest-VolumesActionsTest-752960189 None] Created volume successfully. Aug 04 12:26:42 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d5f7d119-5586-448a-a0d6-baa2eb902552" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:42 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b Aug 04 12:26:42 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-d5f7d119-5586-448a-a0d6-baa2eb902552" released by "delete_volume" :: held 0.846s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Created reservations ['a5f56b67-e994-43db-b0fd-983c2a4cd16d', 'dd5953be-b1dd-4377-bcd8-ef2a702406f8', 'accd231c-8336-45b4-80b6-647bd3b85276', '74a96715-e8f0-4fe0-aee0-e96432aeb45b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:42 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:42 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:42 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" returned: 0 in 0.616s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:42 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d 1G Aug 04 12:26:42 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:43 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.418s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Deleted volume successfully. Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bc2e33d-85fe-4eb3-abd8-4a31c3da5686 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-d5f7d119-5586-448a-a0d6-baa2eb902552-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (55c3429b-6618-40de-9ea0-5138992f85ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:43 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c350208-cc7d-4119-8ad2-76e9527b0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d 1G" returned: 0 in 0.819s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:43 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d Aug 04 12:26:43 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c350208-cc7d-4119-8ad2-76e9527b0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034395491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e336996-1127-4629-9425-e93736c0fda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:44Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2338af5-65d5-409d-bb9d-9823afd6d2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2338af5-65d5-409d-bb9d-9823afd6d2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a755e3-7f8a-41ae-b938-355af00539ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a755e3-7f8a-41ae-b938-355af00539ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e336996-1127-4629-9425-e93736c0fda7', 'volume_name': 'volume-0e336996-1127-4629-9425-e93736c0fda7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a19f8-3781-4324-ab4d-37175cce4ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a19f8-3781-4324-ab4d-37175cce4ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94efca75-d3d9-4242-822b-32f6c0fbacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:43 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Volume 0e336996-1127-4629-9425-e93736c0fda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e336996-1127-4629-9425-e93736c0fda7', 'volume_size': 1} Aug 04 12:26:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:44 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:44 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d is being set with open permissions: ugo+rw Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:44 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d Aug 04 12:26:44 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:44 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d" returned: 0 in 0.384s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:44 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info Aug 04 12:26:44 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:44 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info" returned: 0 in 0.333s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:44 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info is being set with open permissions: ugo+rw Aug 04 12:26:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:44 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info Aug 04 12:26:44 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:45 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.info" returned: 0 in 0.318s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034395491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e336996-1127-4629-9425-e93736c0fda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:44Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Creating volume 0e336996-1127-4629-9425-e93736c0fda7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:45 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 1073741824 Aug 04 12:26:45 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-deecd97f-275a-4006-927a-75b1fd6188db tempest-VolumesSnapshotTestJSON-621798158 None] Create snapshot completed successfully Aug 04 12:26:46 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 1073741824" returned: 0 in 0.822s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-3d7785d2-6191-413f-a997-bddbb59bb26d-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:46 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 Aug 04 12:26:46 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-3d7785d2-6191-413f-a997-bddbb59bb26d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-3d7785d2-6191-413f-a997-bddbb59bb26d" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3d7785d2-6191-413f-a997-bddbb59bb26d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Deleting offline snapshot 3d7785d2-6191-413f-a997-bddbb59bb26d of volume 2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] snapshot_file for this snap is: volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d9746-caba-4ae5-aeba-bd90febc6268]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:46 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7" returned: 0 in 0.418s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:46 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d Aug 04 12:26:46 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94efca75-d3d9-4242-822b-32f6c0fbacdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e336996-1127-4629-9425-e93736c0fda7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ee8396-7adc-422e-b012-196c7ee20ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Volume volume-0e336996-1127-4629-9425-e93736c0fda7 (0e336996-1127-4629-9425-e93736c0fda7): created successfully Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ee8396-7adc-422e-b012-196c7ee20ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (55c3429b-6618-40de-9ea0-5138992f85ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cff6bc87-1505-4ada-9030-392674faf8b0 tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:46 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d" returned: 0 in 0.629s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a3de39-17a5-4b52-a7b1-9238cdd106d4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-0e336996-1127-4629-9425-e93736c0fda7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-0e336996-1127-4629-9425-e93736c0fda7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "cinder-quobyte-0e336996-1127-4629-9425-e93736c0fda7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:47 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b Aug 04 12:26:47 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-0e336996-1127-4629-9425-e93736c0fda7" acquired by "delete_volume" :: waited 0.047s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d6a4a-e8eb-4cb6-9a25-ce6075d5921f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:47 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 Aug 04 12:26:47 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:47 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" returned: 0 in 0.752s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:47 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d Aug 04 12:26:47 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:48 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7" returned: 0 in 0.673s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:48 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7 Aug 04 12:26:48 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:48 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:48 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d Aug 04 12:26:48 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:48 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b.3d7785d2-6191-413f-a997-bddbb59bb26d" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:48 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0e336996-1127-4629-9425-e93736c0fda7" returned: 0 in 0.533s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3d7785d2-6191-413f-a997-bddbb59bb26d" released by "_delete_snapshot" :: held 2.371s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-quobyte-0e336996-1127-4629-9425-e93736c0fda7" released by "delete_volume" :: held 1.302s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" released by "delete_snapshot" :: held 2.408s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Created reservations ['cd6dfd91-6bcc-422a-8d86-f5d9442c4b17', 'b66af0b9-08e1-46b8-af18-f5ceeaca741c', 'cb6115d5-6acc-4e62-af91-e8cba442f519', 'd9645a70-1605-4711-bc40-0ce432c1bae2'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['32b87231-a3cb-4266-9d46-7076b15dea37', 'da059c4a-36ba-485c-9684-56b86258f502', 'e29cc974-25f1-4c7a-857c-ff06502c52e4', 'a3ad3e36-a280-4a6b-a717-8efe80df93aa'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=113,cinder:UPDATE=158,cinder:INSERT=38,cinder:DELETE=14 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:26:48 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:48 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Delete snapshot completed successfully. Aug 04 12:26:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83b91523-f6a7-416b-8db6-bee51237f32f tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-3d7785d2-6191-413f-a997-bddbb59bb26d-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:49 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.333s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:49 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Deleted volume successfully. Aug 04 12:26:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a13e6cfd-8ce5-4e6f-af44-49484ae7bd75 tempest-VolumesActionsTest-2129872426 None] Lock "cinder-0e336996-1127-4629-9425-e93736c0fda7-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=127,cinder:UPDATE=149,cinder:DELETE=13,cinder:INSERT=32 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (502dc478-1781-424f-8072-b1e1f1919227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e129ad53-ee0f-48c2-b6ba-45a0ca859b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e129ad53-ee0f-48c2-b6ba-45a0ca859b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726150921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9638592c-13a6-4886-a49c-3f93ef65ac89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:51Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ebd362-29ac-4b92-9ff7-46091649d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ebd362-29ac-4b92-9ff7-46091649d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8778c-fbc4-4cb4-b843-2c0685cec87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8778c-fbc4-4cb4-b843-2c0685cec87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9638592c-13a6-4886-a49c-3f93ef65ac89', 'volume_name': 'volume-9638592c-13a6-4886-a49c-3f93ef65ac89', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271e6fa8-d354-4221-b4fa-40f7294a710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271e6fa8-d354-4221-b4fa-40f7294a710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733f2726-9b59-4501-a7d0-cb2bd23d8935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Volume 9638592c-13a6-4886-a49c-3f93ef65ac89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9638592c-13a6-4886-a49c-3f93ef65ac89', 'volume_size': 1} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726150921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9638592c-13a6-4886-a49c-3f93ef65ac89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:51Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Creating volume 9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:51 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:51 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 1073741824 Aug 04 12:26:51 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (10886839-3757-49f4-a293-9932f628aff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e05a6b-d7a6-453a-802f-f269071469ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e05a6b-d7a6-453a-802f-f269071469ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455564438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718300b6-4331-4f75-a57f-c470aa91271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:51Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7f1cbd-3aab-422c-a2e0-25b045cfd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7f1cbd-3aab-422c-a2e0-25b045cfd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fd73fa-3644-47ab-ab84-e4142afbe82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fd73fa-3644-47ab-ab84-e4142afbe82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718300b6-4331-4f75-a57f-c470aa91271b', 'volume_name': 'volume-718300b6-4331-4f75-a57f-c470aa91271b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fa29e9-a753-4d74-8d48-222220e387be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fa29e9-a753-4d74-8d48-222220e387be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4231787-bb67-418c-b240-f6f7b676d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Volume 718300b6-4331-4f75-a57f-c470aa91271b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718300b6-4331-4f75-a57f-c470aa91271b', 'volume_size': 1} Aug 04 12:26:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:52 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 1073741824" returned: 0 in 0.642s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:52 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:26:52 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:52 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455564438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718300b6-4331-4f75-a57f-c470aa91271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67538eb420024821ad84aacbab56c992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:51Z,use_quota=True,user_id='617af75caefa457dbad21427cc16bba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Creating volume 718300b6-4331-4f75-a57f-c470aa91271b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:52 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733f2726-9b59-4501-a7d0-cb2bd23d8935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9638592c-13a6-4886-a49c-3f93ef65ac89', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:52 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b 1073741824 Aug 04 12:26:52 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb673cc-f1cd-4b26-9027-a1d1db311035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Volume volume-9638592c-13a6-4886-a49c-3f93ef65ac89 (9638592c-13a6-4886-a49c-3f93ef65ac89): created successfully Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb673cc-f1cd-4b26-9027-a1d1db311035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (502dc478-1781-424f-8072-b1e1f1919227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-68d4a40c-c2c5-4e5e-8b50-6e183d2b10a6 tempest-VolumesSnapshotTestJSON-621798158 None] Created volume successfully. Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:53 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b 1073741824" returned: 0 in 0.751s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:53 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b Aug 04 12:26:53 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:53 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b" returned: 0 in 0.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4231787-bb67-418c-b240-f6f7b676d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718300b6-4331-4f75-a57f-c470aa91271b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8630cb-0626-49df-ab78-2cc0638e9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Creating offline snapshot 930020da-364e-4bdc-90f1-6061d4a46616 of volume 9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:26:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Volume volume-718300b6-4331-4f75-a57f-c470aa91271b (718300b6-4331-4f75-a57f-c470aa91271b): created successfully Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8630cb-0626-49df-ab78-2cc0638e9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Flow 'volume_create_manager' (10886839-3757-49f4-a293-9932f628aff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a10918-9caf-4a6d-a1d2-7c85ad9d8951]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f4ea7b1f-5ef4-4be2-b043-66336351c31d tempest-VolumesActionsTest-392532842 None] Created volume successfully. Aug 04 12:26:53 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:26:53 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:54 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 0.395s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:54 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 1G Aug 04 12:26:54 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:54 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 1G" returned: 0 in 0.454s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9638592c-13a6-4886-a49c-3f93ef65ac89 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:54 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9638592c-13a6-4886-a49c-3f93ef65ac89 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:26:54 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-50be411e-bd43-4d24-8620-367c70a70c66 tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" by "attach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-50be411e-bd43-4d24-8620-367c70a70c66 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" acquired by "attach_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:55 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9638592c-13a6-4886-a49c-3f93ef65ac89 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.462s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:55 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 is being set with open permissions: ugo+rw Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-718300b6-4331-4f75-a57f-c470aa91271b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:55 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:26:55 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "cinder-718300b6-4331-4f75-a57f-c470aa91271b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-50be411e-bd43-4d24-8620-367c70a70c66 tempest-VolumesActionsTest-752960189 None] Attaching volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272 to instance 7e3d01bd-5003-43f2-bf65-c2a48b2688d0 at mountpoint /dev/vdb on host None. Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Acquiring lock "cinder-quobyte-718300b6-4331-4f75-a57f-c470aa91271b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-50be411e-bd43-4d24-8620-367c70a70c66 tempest-VolumesActionsTest-752960189 None] Attach volume completed successfully. Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "cinder-quobyte-718300b6-4331-4f75-a57f-c470aa91271b" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-50be411e-bd43-4d24-8620-367c70a70c66 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" released by "attach_volume" :: held 0.215s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb376016-050f-4e80-8ef8-9413cce7c1e7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0556127e-fbad-4a0b-ba9c-567f2099d51a tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" by "detach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0556127e-fbad-4a0b-ba9c-567f2099d51a tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0556127e-fbad-4a0b-ba9c-567f2099d51a tempest-VolumesActionsTest-752960189 None] Detaching volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272 from instance 7e3d01bd-5003-43f2-bf65-c2a48b2688d0. Aug 04 12:26:55 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:55 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b Aug 04 12:26:55 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0556127e-fbad-4a0b-ba9c-567f2099d51a tempest-VolumesActionsTest-752960189 None] Detach volume completed successfully. Aug 04 12:26:55 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info Aug 04 12:26:55 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0556127e-fbad-4a0b-ba9c-567f2099d51a tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:55 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b" returned: 0 in 0.511s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:55 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b Aug 04 12:26:55 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:55 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:55 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info is being set with open permissions: ugo+rw Aug 04 12:26:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:56 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info Aug 04 12:26:56 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:56 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-718300b6-4331-4f75-a57f-c470aa91271b" returned: 0 in 0.350s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "cinder-quobyte-718300b6-4331-4f75-a57f-c470aa91271b" released by "delete_volume" :: held 0.925s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Created reservations ['d6495985-58f1-4c43-a63d-8e5f171e58e2', '92d309b2-c538-4727-ae8d-00a5be088ae4', 'a24177a4-41d2-4175-b57b-59cfcec51b6a', '3ecd82d8-b9db-40e5-aa89-6bb85a5c2175'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:26:56 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.info" returned: 0 in 0.323s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8b0285e4-de98-4071-8aae-1b8fbed62b7c tempest-VolumesSnapshotTestJSON-621798158 None] Create snapshot completed successfully Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:56 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:26:56 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:56 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.302s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:26:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Deleted volume successfully. Aug 04 12:26:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dc61a23c-f238-418d-9405-22b868b58d6c tempest-VolumesActionsTest-392532842 None] Lock "cinder-718300b6-4331-4f75-a57f-c470aa91271b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (a319ea40-1f48-427e-9152-f831694869c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37111ff5-1a02-4326-9b52-00e551f64bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37111ff5-1a02-4326-9b52-00e551f64bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482048076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1e6a51-c3c4-4f88-8208-5292d89371c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:26:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=930020da-364e-4bdc-90f1-6061d4a46616,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:26:58Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbaa1f3-e9b6-417e-9dbe-816d9bb3f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbaa1f3-e9b6-417e-9dbe-816d9bb3f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40506eb-99d8-485d-9a15-aa6a9a81389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40506eb-99d8-485d-9a15-aa6a9a81389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b1e6a51-c3c4-4f88-8208-5292d89371c7', 'volume_name': 'volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7', 'volume_size': 2, 'snapshot_id': '930020da-364e-4bdc-90f1-6061d4a46616'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb21be1-2314-4732-b8c5-daab1925647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb21be1-2314-4732-b8c5-daab1925647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e52a61-d53d-49c3-a345-009e843fc0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:26:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Volume 2b1e6a51-c3c4-4f88-8208-5292d89371c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7', 'volume_size': 2, 'snapshot_id': '930020da-364e-4bdc-90f1-6061d4a46616'} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616-2b1e6a51-c3c4-4f88-8208-5292d89371c7" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616-2b1e6a51-c3c4-4f88-8208-5292d89371c7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Creating volume 2b1e6a51-c3c4-4f88-8208-5292d89371c7 from snapshot 930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] snapshot: 930020da-364e-4bdc-90f1-6061d4a46616, volume: 2b1e6a51-c3c4-4f88-8208-5292d89371c7, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb43d5bb-ac8b-4039-9633-552f075fa60b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:58 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:26:58 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:58 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.402s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9638592c-13a6-4886-a49c-3f93ef65ac89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[38779b44-1190-4c9b-866c-53fd77041dfb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:26:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:58 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:26:58 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:26:59 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Aug 04 12:26:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 0.496s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:26:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:26:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:26:59 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:26:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:26:59 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 Aug 04 12:26:59 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:06 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7" returned: 0 in 6.972s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:27:06 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Converted 1024.00 MB image at 146.84 MB/s Aug 04 12:27:06 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 is being set with open permissions: ugo+rw Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:06 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 Aug 04 12:27:06 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:06 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:06 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:06 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.316s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:06 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" released by "_copy_volume_from_snapshot" :: held 8.378s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616-2b1e6a51-c3c4-4f88-8208-5292d89371c7" released by "_create_volume_from_snapshot" :: held 8.467s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.487s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e52a61-d53d-49c3-a345-009e843fc0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7', 'volume_size': 2, 'snapshot_id': '930020da-364e-4bdc-90f1-6061d4a46616'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04bac49-f5aa-4502-9878-a4a8872173cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Volume volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 (2b1e6a51-c3c4-4f88-8208-5292d89371c7): created successfully Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04bac49-f5aa-4502-9878-a4a8872173cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (a319ea40-1f48-427e-9152-f831694869c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-33a799f3-20ce-4228-85ef-d1385701b18c tempest-VolumesSnapshotTestJSON-621798158 None] Created volume successfully. Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-2b1e6a51-c3c4-4f88-8208-5292d89371c7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-2b1e6a51-c3c4-4f88-8208-5292d89371c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c8b03-e3a7-48c8-97d0-ce30b3c6494a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:07 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 Aug 04 12:27:07 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:08 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7" returned: 0 in 0.468s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:08 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7 Aug 04 12:27:08 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:08 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2b1e6a51-c3c4-4f88-8208-5292d89371c7" returned: 0 in 0.280s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2b1e6a51-c3c4-4f88-8208-5292d89371c7" released by "delete_volume" :: held 0.802s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['8c9f9c29-ec36-4dfe-a4a5-ea3bf98ebb93', '587066bb-6aa1-495a-a959-fda590f5e6e6', 'e19af43f-9f54-4012-bf2b-45a4ab872200', '6ae9cd9a-b748-45f9-bfda-1d61f760a186'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:08 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:08 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-930020da-364e-4bdc-90f1-6061d4a46616-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-930020da-364e-4bdc-90f1-6061d4a46616-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Deleting offline snapshot 930020da-364e-4bdc-90f1-6061d4a46616 of volume 9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] snapshot_file for this snap is: volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff5e3a-e979-4481-b910-14f5d01577e0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:08 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Deleted volume successfully. Aug 04 12:27:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65081cc3-a923-4a5e-9868-dc8c8ea7fb7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-2b1e6a51-c3c4-4f88-8208-5292d89371c7-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:09 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:27:09 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:09 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.550s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9638592c-13a6-4886-a49c-3f93ef65ac89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:27:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668ff7a-04dc-48fa-98e7-846ad2325079]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:09 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:27:09 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:10 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 1.043s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:10 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:27:10 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:11 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.671s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:11 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616 Aug 04 12:27:11 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:11 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89.930020da-364e-4bdc-90f1-6061d4a46616" returned: 0 in 0.467s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-930020da-364e-4bdc-90f1-6061d4a46616" released by "_delete_snapshot" :: held 2.884s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" released by "delete_snapshot" :: held 2.914s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['58134f0d-5d9a-4e98-b0ae-01b41636ec6a', '61078fa7-e825-4c0e-a37e-7c3889a334e9', '57f3130d-05cb-4bf5-bc64-d72a7ecb339b', 'ce9bf914-e7bc-4bc2-9ecb-cd5e3b02cacb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Delete snapshot completed successfully. Aug 04 12:27:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-378f99f0-6f06-4e2b-938f-449217577e81 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-930020da-364e-4bdc-90f1-6061d4a46616-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-9638592c-13a6-4886-a49c-3f93ef65ac89-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-9638592c-13a6-4886-a49c-3f93ef65ac89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce54c2-add6-403f-a991-9eea7b0738f8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:12 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:27:12 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:13 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 0.630s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:13 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89 Aug 04 12:27:13 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:13 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9638592c-13a6-4886-a49c-3f93ef65ac89" returned: 0 in 0.516s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-9638592c-13a6-4886-a49c-3f93ef65ac89" released by "delete_volume" :: held 1.263s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['01b0368a-631e-4159-936c-a7f98b766617', 'eca45756-481c-4ae2-b753-02e24e0f83d9', '834df752-5525-4e84-bd9e-46301a03b34d', 'e500b23b-85cf-440a-9829-82e32e6a5343'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:14 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:14 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-726c015b-dde2-4829-b7c8-1f6fb0cc61b1 req-05713aba-bebc-40b9-8570-53ed394a9f9d tempest-AttachVolumeNegativeTest-22382868 None] Terminate volume connection completed successfully. Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-726c015b-dde2-4829-b7c8-1f6fb0cc61b1 req-05713aba-bebc-40b9-8570-53ed394a9f9d tempest-AttachVolumeNegativeTest-22382868 None] Deleting attachment 09e20801-25ad-413c-bdc7-e1feb9568928. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3afdf47b-532b-4e83-8407-e951458e6b46 tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" by "attach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:14 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.540s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Deleted volume successfully. Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3afdf47b-532b-4e83-8407-e951458e6b46 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" acquired by "attach_volume" :: waited 0.097s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-25ca3cfb-3e11-4c1a-be3d-a4675b194f02 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-9638592c-13a6-4886-a49c-3f93ef65ac89-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3afdf47b-532b-4e83-8407-e951458e6b46 tempest-VolumesActionsTest-752960189 None] Attaching volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272 to instance 3c30bc44-b0c9-4eb1-9b93-a5ed93e3e517 at mountpoint /dev/vdb on host None. Aug 04 12:27:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3afdf47b-532b-4e83-8407-e951458e6b46 tempest-VolumesActionsTest-752960189 None] Attach volume completed successfully. Aug 04 12:27:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3afdf47b-532b-4e83-8407-e951458e6b46 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" released by "attach_volume" :: held 0.209s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a60848b-b493-4fb7-b6ca-a2edfc323cdb tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" by "detach_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a60848b-b493-4fb7-b6ca-a2edfc323cdb tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6a60848b-b493-4fb7-b6ca-a2edfc323cdb tempest-VolumesActionsTest-752960189 None] Detaching volume ae78f711-a5e4-4c1d-a429-0f3fb8c38272 from instance 3c30bc44-b0c9-4eb1-9b93-a5ed93e3e517. Aug 04 12:27:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6a60848b-b493-4fb7-b6ca-a2edfc323cdb tempest-VolumesActionsTest-752960189 None] Detach volume completed successfully. Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a60848b-b493-4fb7-b6ca-a2edfc323cdb tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (205fbe85-c404-4c23-9373-ede5532bf2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777272ff-6b2e-43bb-8fe6-aa8945d6729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777272ff-6b2e-43bb-8fe6-aa8945d6729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015815410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e49868b-def9-4fad-8a4d-08e427c1ac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:27:16Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3979c6eb-0539-472c-99dd-ecf7cb6d5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3979c6eb-0539-472c-99dd-ecf7cb6d5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8c7f5a-86a7-4c17-9951-31e89c4a01d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8c7f5a-86a7-4c17-9951-31e89c4a01d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e49868b-def9-4fad-8a4d-08e427c1ac27', 'volume_name': 'volume-3e49868b-def9-4fad-8a4d-08e427c1ac27', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d231ce6b-c280-4e29-9d9b-4ceddb3fef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d231ce6b-c280-4e29-9d9b-4ceddb3fef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c730c38-3a4e-4af1-bbed-737b27a5c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Volume 3e49868b-def9-4fad-8a4d-08e427c1ac27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e49868b-def9-4fad-8a4d-08e427c1ac27', 'volume_size': 1} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015815410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e49868b-def9-4fad-8a4d-08e427c1ac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:27:16Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Creating volume 3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:27:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:27:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:15 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 1073741824 Aug 04 12:27:15 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:16 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 1073741824" returned: 0 in 0.843s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:16 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:16 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:17 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 0.595s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c730c38-3a4e-4af1-bbed-737b27a5c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e49868b-def9-4fad-8a4d-08e427c1ac27', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0fd97d-b187-4cb6-b8bd-d89fd4244efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Volume volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 (3e49868b-def9-4fad-8a4d-08e427c1ac27): created successfully Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0fd97d-b187-4cb6-b8bd-d89fd4244efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (205fbe85-c404-4c23-9373-ede5532bf2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-066176c9-28d3-464b-b846-22fcb1284e7a tempest-VolumesSnapshotTestJSON-621798158 None] Created volume successfully. Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Creating offline snapshot 8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 of volume 3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:27:18 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a2359-f668-4b78-a3c8-12e5659a553a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:18 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:18 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:18 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 0.548s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:18 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 1G Aug 04 12:27:18 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:19 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 1G" returned: 0 in 0.620s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:19 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:19 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:19 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:19 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 is being set with open permissions: ugo+rw Aug 04 12:27:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:19 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:19 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:19 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.349s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:20 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info Aug 04 12:27:20 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:20 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info" returned: 0 in 0.285s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:20 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info is being set with open permissions: ugo+rw Aug 04 12:27:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:20 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info Aug 04 12:27:20 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:20 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.info" returned: 0 in 0.281s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c4fb6fa6-246c-463f-8ad4-42fdea2ce831 tempest-VolumesSnapshotTestJSON-621798158 None] Create snapshot completed successfully Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (90b48768-cc09-46d8-bb6c-cddec686faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b42c86b-570e-49c6-a4e9-48313517c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b42c86b-570e-49c6-a4e9-48313517c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-31278543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ffe763-44e3-4a43-b743-eaaa503723f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc584ae8f84ffe8fec83eee67537b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:27:22Z,use_quota=True,user_id='2f4ca92262d84894921e4389d959d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21655cd7-803c-4612-a8bd-adf088f4ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21655cd7-803c-4612-a8bd-adf088f4ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afeb019a-dbc8-4629-b501-952065982c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afeb019a-dbc8-4629-b501-952065982c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03ffe763-44e3-4a43-b743-eaaa503723f5', 'volume_name': 'volume-03ffe763-44e3-4a43-b743-eaaa503723f5', 'volume_size': 1, 'snapshot_id': '8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e63c12-07bc-4500-90cd-3f41cbe5d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e63c12-07bc-4500-90cd-3f41cbe5d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e908aec-5d52-4361-a472-f714194763b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Volume 03ffe763-44e3-4a43-b743-eaaa503723f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03ffe763-44e3-4a43-b743-eaaa503723f5', 'volume_size': 1, 'snapshot_id': '8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5'} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-03ffe763-44e3-4a43-b743-eaaa503723f5" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-03ffe763-44e3-4a43-b743-eaaa503723f5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Creating volume 03ffe763-44e3-4a43-b743-eaaa503723f5 from snapshot 8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] snapshot: 8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5, volume: 03ffe763-44e3-4a43-b743-eaaa503723f5, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e29cdf6-b366-41c5-8295-9576a893b1a1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:22 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:22 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Flow 'volume_create_manager' (c65f7e66-5db4-472a-9778-1908d7d1394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374da31a-566b-4762-a041-efd49a07245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374da31a-566b-4762-a041-efd49a07245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1729389937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7599e28d-d6ca-4f42-bb28-46ff58613b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888a153212774d028b51b7a35ea1006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:27:22Z,use_quota=True,user_id='9e66e509e5a84c989c4a8e903d81c131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68caa479-36dd-4e26-b674-7c04be429776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68caa479-36dd-4e26-b674-7c04be429776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4126d9b-76fe-4b9f-bdb3-fc32b2200531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4126d9b-76fe-4b9f-bdb3-fc32b2200531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7599e28d-d6ca-4f42-bb28-46ff58613b0b', 'volume_name': 'volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e261aa8-7785-4db1-8ede-f9154a988c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e261aa8-7785-4db1-8ede-f9154a988c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5c62c9-7df0-4c62-9c3d-c2f29c5f090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Volume 7599e28d-d6ca-4f42-bb28-46ff58613b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b', 'volume_size': 1} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:22 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.432s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e49868b-def9-4fad-8a4d-08e427c1ac27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9a9e1-deb0-45a0-85de-0108897ecb78]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:22 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:22 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:22 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 0.387s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:27:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:22 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 Aug 04 12:27:22 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:27 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5" returned: 0 in 4.863s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:27 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:27:27 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Converted 1024.00 MB image at 210.49 MB/s Aug 04 12:27:27 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 is being set with open permissions: ugo+rw Aug 04 12:27:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:27 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 Aug 04 12:27:27 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:28 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5" returned: 0 in 0.299s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" released by "_copy_volume_from_snapshot" :: held 6.079s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-03ffe763-44e3-4a43-b743-eaaa503723f5" released by "_create_volume_from_snapshot" :: held 6.160s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.192s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.170s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abddaca-c4d6-4e36-8ecc-7202337b2530]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e908aec-5d52-4361-a472-f714194763b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ffe763-44e3-4a43-b743-eaaa503723f5', 'volume_size': 1, 'snapshot_id': '8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f3ce3-bbf2-430e-8b4a-e124792e49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:27:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Volume volume-03ffe763-44e3-4a43-b743-eaaa503723f5 (03ffe763-44e3-4a43-b743-eaaa503723f5): created successfully Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f3ce3-bbf2-430e-8b4a-e124792e49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Flow 'volume_create_manager' (90b48768-cc09-46d8-bb6c-cddec686faae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:27:28 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2becc11d-313c-49ed-8e46-32af2994d925 tempest-VolumesSnapshotTestJSON-621798158 None] Created volume successfully. Aug 04 12:27:28 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:27:28 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:28 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.416s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a4e024-b05b-431a-b8d9-f81649999521]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:28 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:27:28 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-03ffe763-44e3-4a43-b743-eaaa503723f5-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-03ffe763-44e3-4a43-b743-eaaa503723f5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876c7fe-2c22-4ab0-bb34-7a9673615fc2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:29 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.523s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.6284bb3b-9a8d-45e7-9de3-508e6220d9fawdtiq4f1.img {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:29 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 Aug 04 12:27:29 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:29 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.6284bb3b-9a8d-45e7-9de3-508e6220d9fawdtiq4f1.img Aug 04 12:27:29 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:29 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5" returned: 0 in 0.706s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:29 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5 Aug 04 12:27:29 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:30 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-03ffe763-44e3-4a43-b743-eaaa503723f5" returned: 0 in 0.636s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-03ffe763-44e3-4a43-b743-eaaa503723f5" released by "delete_volume" :: held 1.436s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['6159cfcc-9101-4226-a8e1-06248c1b4bbd', 'a98181e3-f883-4b38-8d63-8c2753cb1ab6', '5bfb5d9c-9cc4-4ef7-8279-9b0cba7240c5', '64b287c6-dc22-4906-85f1-3abed1d5b1f6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:30 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:30 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Deleting offline snapshot 8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 of volume 3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] snapshot_file for this snap is: volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:27:31 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b871dd-31a6-4e85-ab90-cc300f8a34c1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 1.127s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:31 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Deleted volume successfully. Aug 04 12:27:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-08dd1729-38b6-48a3-8c9d-4e89a7d44bc9 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-03ffe763-44e3-4a43-b743-eaaa503723f5-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:32 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:32 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:32 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.774s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e49868b-def9-4fad-8a4d-08e427c1ac27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:27:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[83594ff4-ca1d-4914-96ac-1c54c90fbf18]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:32 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:33 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:34 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 1.589s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:34 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:34 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:35 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.995s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:35 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5 Aug 04 12:27:35 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:35 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.6284bb3b-9a8d-45e7-9de3-508e6220d9fawdtiq4f1.img" returned: 0 in 6.483s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[990154b4-5491-416b-b1a3-775288ff0cb8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:35 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:27:35 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:35 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27.8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" returned: 0 in 0.537s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5" released by "_delete_snapshot" :: held 4.191s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" released by "delete_snapshot" :: held 4.276s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['4786fe00-ebc9-4e3c-bdc3-cccebe7a87cc', 'b48efbac-3c2b-4fb0-8341-3d18bbf7deff', 'f8c3e06c-83b4-4e01-94c0-e70a2e8851fe', 'f640348c-f8e1-4674-919e-e343d5be400a'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Delete snapshot completed successfully. Aug 04 12:27:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4ee9bc45-35e3-4818-a80f-75401662f598 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-8ffdc3d7-ab0d-45e9-bf0d-34cdfdbadab5-delete_snapshot" released by "delete_snapshot" :: held 4.470s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:36 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.696s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:36 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.6284bb3b-9a8d-45e7-9de3-508e6220d9fawdtiq4f1.img {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:27:36 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Converted 1024.00 MB image at 157.92 MB/s Aug 04 12:27:36 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] 6284bb3b-9a8d-45e7-9de3-508e6220d9fa was raw, no need to convert to raw {{(pid=88895) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-3e49868b-def9-4fad-8a4d-08e427c1ac27-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-3e49868b-def9-4fad-8a4d-08e427c1ac27-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d9955-da7a-424d-b2a6-4698906fb64d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:37 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:37 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:37 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 0.507s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:38 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27 Aug 04 12:27:38 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:38 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3e49868b-def9-4fad-8a4d-08e427c1ac27" returned: 0 in 0.439s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-3e49868b-def9-4fad-8a4d-08e427c1ac27" released by "delete_volume" :: held 1.104s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['212dd668-d984-4390-ac7d-102dbfa612e7', 'd2fe4be0-12bb-49e4-8d8a-c2c6982fa338', 'ed58eefa-1492-4b20-90b3-3118644ef45e', '47813186-487d-47d9-b4b2-b3ba7fa8484e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:38 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:38 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:39 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.449s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Deleted volume successfully. Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c620849-de44-42c1-a979-1999f7470060 tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-3e49868b-def9-4fad-8a4d-08e427c1ac27-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:27:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:27:40 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aef5db-361f-4113-b1aa-570ad60e6b84]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:27:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:40 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b Aug 04 12:27:40 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:40 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" returned: 0 in 0.607s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:40 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b Aug 04 12:27:40 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:40 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-quobyte-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b" released by "delete_volume" :: held 1.048s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Created reservations ['3583782e-2a53-4746-90ea-6fd97b3718b0', '7d42a42e-82f6-4fd6-8cef-aaa0a5594ecc', '33c80c8e-7248-4f5e-ad64-658f99cac5a4', 'b00237e6-991f-4465-a0ca-5f30f7720586'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:41 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:27:41 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:41 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.300s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:27:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Deleted volume successfully. Aug 04 12:27:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cf6d88da-79f4-43cd-a611-03ae8c7429fb tempest-VolumesSnapshotTestJSON-621798158 None] Lock "cinder-2a4a9eae-528e-45d8-bbd8-ebbd048a5b0b-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:27:51 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:DELETE=4,cinder:UPDATE=81,cinder:SELECT=74,cinder:INSERT=20 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:27:51 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=80,cinder:UPDATE=86,cinder:DELETE=10,cinder:INSERT=23 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.421s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Uploaded volume to glance image-id: 6284bb3b-9a8d-45e7-9de3-508e6220d9fa. {{(pid=88895) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.127s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1729389937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7599e28d-d6ca-4f42-bb28-46ff58613b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888a153212774d028b51b7a35ea1006e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:27:22Z,use_quota=True,user_id='9e66e509e5a84c989c4a8e903d81c131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Creating volume 7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:27:59 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:27:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:27:59 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b 1073741824 Aug 04 12:27:59 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:27:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4337e04a-0b7e-431b-b18b-e0b6ddfcb768 tempest-VolumesActionsTest-752960189 None] Copy volume to image completed successfully. Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (4bd03415-031c-476f-9fc1-eb5df87a78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73096884-148c-4dd3-9b05-66b429e2851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73096884-148c-4dd3-9b05-66b429e2851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-452793301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1287494c-9297-4fe0-bbb2-e4526c27af9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:00Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a1529-9c09-4fe8-8b31-c504e86c1a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6a1529-9c09-4fe8-8b31-c504e86c1a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a031e098-d0e9-4747-9f30-29f87ce227ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a031e098-d0e9-4747-9f30-29f87ce227ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1287494c-9297-4fe0-bbb2-e4526c27af9a', 'volume_name': 'volume-1287494c-9297-4fe0-bbb2-e4526c27af9a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f13d12b-5144-4d65-b676-3a1c67c8c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f13d12b-5144-4d65-b676-3a1c67c8c23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5375243-d0a3-42ed-a4ea-d7e5fb1ca807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Volume 1287494c-9297-4fe0-bbb2-e4526c27af9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1287494c-9297-4fe0-bbb2-e4526c27af9a', 'volume_size': 1} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:00 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b 1073741824" returned: 0 in 0.599s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:00 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b Aug 04 12:28:00 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:00 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b" returned: 0 in 0.298s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-452793301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1287494c-9297-4fe0-bbb2-e4526c27af9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:00Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Creating volume 1287494c-9297-4fe0-bbb2-e4526c27af9a {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:00 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5c62c9-7df0-4c62-9c3d-c2f29c5f090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a 1073741824 Aug 04 12:28:00 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0387db-7946-459a-abfc-441c797e5c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Volume volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b (7599e28d-d6ca-4f42-bb28-46ff58613b0b): created successfully Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0387db-7946-459a-abfc-441c797e5c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Flow 'volume_create_manager' (c65f7e66-5db4-472a-9778-1908d7d1394e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-42132300-22cd-487b-9732-b43b89b77f90 tempest-SnapshotMetadataTestJSON-258911399 None] Created volume successfully. Aug 04 12:28:01 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a 1073741824" returned: 0 in 0.569s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:01 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a Aug 04 12:28:01 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:01 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.158s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5375243-d0a3-42ed-a4ea-d7e5fb1ca807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1287494c-9297-4fe0-bbb2-e4526c27af9a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb36b36-052d-47a2-938c-fb2ed30428e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[39973785-bf0f-407c-8491-c124d0019d59]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Volume volume-1287494c-9297-4fe0-bbb2-e4526c27af9a (1287494c-9297-4fe0-bbb2-e4526c27af9a): created successfully Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb36b36-052d-47a2-938c-fb2ed30428e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (4bd03415-031c-476f-9fc1-eb5df87a78d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-71ffe8af-d286-4993-8230-641eacbcdb3a tempest-AttachVolumeNegativeTest-22382868 None] Created volume successfully. Aug 04 12:28:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:01 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:28:01 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:02 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.500s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f546ba-c417-45b3-bc1c-c19163ed711b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:02 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:28:02 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:02 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.467s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:02 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img Aug 04 12:28:02 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ff7addd2-57b2-4484-9b2d-31cd1886e4a8 req-34d6e45b-f1d7-483f-8f2c-30b780466b83 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:06 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:06 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:07 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.997s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:28:07 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img" returned: 0 in 5.243s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fba5ef-f15f-4480-90fd-cb9a886fcb01]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:07 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:28:07 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:08 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.555s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:28:08 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Converted 1024.00 MB image at 195.29 MB/s Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] a265df1a-121e-43c7-9b25-42a7e7b7f5ba was raw, converting to qcow2 {{(pid=88895) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c5790-8cbe-48ff-8e0e-0bc0f9f488b8]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:08 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img Aug 04 12:28:08 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:08 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img" returned: 0 in 0.322s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:08 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img Aug 04 12:28:08 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:09 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img" returned: 1 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:09 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw Aug 04 12:28:09 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:09 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Image conversion details: src /opt/stack/data/cinder/conversion/ae78f711-a5e4-4c1d-a429-0f3fb8c38272.temp_image.a265df1a-121e-43c7-9b25-42a7e7b7f5bazgphjo9w.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:28:09 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854b3b1-a609-4b95-9e2f-8f72f7279019]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:09 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw Aug 04 12:28:09 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:09 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m3b5pbxw" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.754s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Uploaded volume to glance image-id: a265df1a-121e-43c7-9b25-42a7e7b7f5ba. {{(pid=88895) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.548s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Creating offline snapshot 527d2df3-21c1-4ba4-965e-269612066060 of volume 7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:28:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f8804b5a-5e48-4406-8bb2-6265564ea136 tempest-VolumesActionsTest-752960189 None] Copy volume to image completed successfully. Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1d757-5848-43c3-9282-9218e3e07d1e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:11 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b Aug 04 12:28:11 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:11 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b" returned: 0 in 0.402s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:11 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 1G Aug 04 12:28:11 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:12 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 1G" returned: 0 in 0.608s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:12 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 Aug 04 12:28:12 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:12 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060" returned: 0 in 0.345s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:12 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 is being set with open permissions: ugo+rw Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:12 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 Aug 04 12:28:12 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:13 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060" returned: 0 in 0.282s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Acquiring lock "cinder-quobyte-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "cinder-quobyte-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc801b3-f459-4492-9f4b-285249ea9613]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:13 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info Aug 04 12:28:13 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:13 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:28:13 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:13 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info" returned: 0 in 0.312s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:13 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info is being set with open permissions: ugo+rw Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:13 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info Aug 04 12:28:13 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:13 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.414s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:13 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272 Aug 04 12:28:13 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:13 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.info" returned: 0 in 0.260s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ff7addd2-57b2-4484-9b2d-31cd1886e4a8 req-34d6e45b-f1d7-483f-8f2c-30b780466b83 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.666s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-ff7addd2-57b2-4484-9b2d-31cd1886e4a8 req-34d6e45b-f1d7-483f-8f2c-30b780466b83 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-de415251-452c-4f30-beb1-c1fe6b15f640 tempest-SnapshotMetadataTestJSON-258911399 None] Create snapshot completed successfully Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-ff7addd2-57b2-4484-9b2d-31cd1886e4a8 req-34d6e45b-f1d7-483f-8f2c-30b780466b83 tempest-AttachVolumeNegativeTest-22382868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-1287494c-9297-4fe0-bbb2-e4526c27af9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '480002cf-46c1-4c83-af01-0c46762daedc', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:28:13 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" returned: 0 in 0.310s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "cinder-quobyte-ae78f711-a5e4-4c1d-a429-0f3fb8c38272" released by "delete_volume" :: held 0.762s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-ff7addd2-57b2-4484-9b2d-31cd1886e4a8 req-34d6e45b-f1d7-483f-8f2c-30b780466b83 tempest-AttachVolumeNegativeTest-22382868 None] attachment_update completed successfully. Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Created reservations ['f0304753-397c-4aea-b10c-b6ca6d691fb1', 'f3bf595c-522d-450a-8cc4-5c9b4d36bc05', 'ca43983a-f0f0-4a1a-bf18-255c372ef076', 'a5748dbe-dc08-48ff-9ade-3f0052be009b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:13 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:13 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:14 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Deleted volume successfully. Aug 04 12:28:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e39bcd1f-4891-4252-a28b-9f8520203593 tempest-VolumesActionsTest-752960189 None] Lock "cinder-ae78f711-a5e4-4c1d-a429-0f3fb8c38272-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "cinder-527d2df3-21c1-4ba4-965e-269612066060-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-527d2df3-21c1-4ba4-965e-269612066060-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "cinder-quobyte-527d2df3-21c1-4ba4-965e-269612066060" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-527d2df3-21c1-4ba4-965e-269612066060" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Deleting offline snapshot 527d2df3-21c1-4ba4-965e-269612066060 of volume 7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] snapshot_file for this snap is: volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4525151-3c83-4d12-bb8e-beba0e00cea8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:15 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 Aug 04 12:28:15 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:16 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060" returned: 0 in 0.541s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a3add8-20ce-4ad7-b98e-94458779d8c4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:16 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b Aug 04 12:28:16 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:16 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b" returned: 0 in 0.670s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:16 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 Aug 04 12:28:16 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:17 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060" returned: 0 in 0.444s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:17 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060 Aug 04 12:28:17 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-2c4de6e0-c674-49ee-b183-e1f7401a51a7 req-18c07176-80f4-469e-9f3d-a4804cafd95a tempest-AttachVolumeNegativeTest-22382868 None] Terminate volume connection completed successfully. Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-2c4de6e0-c674-49ee-b183-e1f7401a51a7 req-18c07176-80f4-469e-9f3d-a4804cafd95a tempest-AttachVolumeNegativeTest-22382868 None] Deleting attachment 480002cf-46c1-4c83-af01-0c46762daedc. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:28:17 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b.527d2df3-21c1-4ba4-965e-269612066060" returned: 0 in 0.421s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-527d2df3-21c1-4ba4-965e-269612066060" released by "_delete_snapshot" :: held 2.237s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" released by "delete_snapshot" :: held 2.265s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Created reservations ['f77811d2-45fc-482e-b374-5262aae59996', 'f0de93d1-92c2-4ab3-a04b-25265433b16b', '8290cb90-b391-4648-9e08-1b7b7315f738', '10d68af0-b56c-48f7-b831-49f3261a7320'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Delete snapshot completed successfully. Aug 04 12:28:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ca1c912-8c1a-4041-a2f6-7827d3957558 tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-527d2df3-21c1-4ba4-965e-269612066060-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "cinder-7599e28d-d6ca-4f42-bb28-46ff58613b0b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-7599e28d-d6ca-4f42-bb28-46ff58613b0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60d5c54-0f9a-47cc-a242-01fc7b8188fc]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:19 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b Aug 04 12:28:19 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:19 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b" returned: 0 in 0.572s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:19 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b Aug 04 12:28:19 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:20 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7599e28d-d6ca-4f42-bb28-46ff58613b0b" returned: 0 in 0.428s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-quobyte-7599e28d-d6ca-4f42-bb28-46ff58613b0b" released by "delete_volume" :: held 1.122s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (8b85cddb-587f-4614-9d54-b5c548400a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e732f-9213-41e4-87c1-5bcd15b46734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Created reservations ['a9c7bd39-e02c-49e0-8d88-9ff8671dd98f', '82af4b9e-58d7-42cc-aad6-836b3a2500af', '67d5eacd-de9c-4ecd-a81e-79110c916b73', 'e65ad4ea-2632-4775-8060-fdd6fb576719'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e732f-9213-41e4-87c1-5bcd15b46734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1914020773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9de95c-4983-4941-b74a-a0e863e16c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:20Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e65c596-aed0-431a-b52a-f17a7ac35828),volume_type_id=9e65c596-aed0-431a-b52a-f17a7ac35828)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c004ea-9f61-4e6e-93e0-d877f4c70d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c004ea-9f61-4e6e-93e0-d877f4c70d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984f722-13f8-4361-83e2-c46902c3967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984f722-13f8-4361-83e2-c46902c3967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9de95c-4983-4941-b74a-a0e863e16c99', 'volume_name': 'volume-2f9de95c-4983-4941-b74a-a0e863e16c99', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbac2af2-ee78-4b2c-bc83-28df37d8c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbac2af2-ee78-4b2c-bc83-28df37d8c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb931b48-73f6-496d-be45-91d37170a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:20 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume 2f9de95c-4983-4941-b74a-a0e863e16c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9de95c-4983-4941-b74a-a0e863e16c99', 'volume_size': 1} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1914020773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9de95c-4983-4941-b74a-a0e863e16c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:20Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e65c596-aed0-431a-b52a-f17a7ac35828),volume_type_id=9e65c596-aed0-431a-b52a-f17a7ac35828)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Creating volume 2f9de95c-4983-4941-b74a-a0e863e16c99 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:20 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:20 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 1073741824 Aug 04 12:28:20 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:20 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:20 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (b1cfce42-d799-44e0-a5de-c80b20b41d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19625640-2b4d-4afe-9902-97d6f84ec0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.516s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19625640-2b4d-4afe-9902-97d6f84ec0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2147133117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed706b67-3f4c-403b-b3d0-4586d680654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:21Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b32d916e-f983-4447-91cf-9ec7483a2943),volume_type_id=b32d916e-f983-4447-91cf-9ec7483a2943)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd98dc35-d0f9-455c-97e6-bcf67ed939f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd98dc35-d0f9-455c-97e6-bcf67ed939f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874c11f7-9df2-4ecd-abdf-d496a9999087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874c11f7-9df2-4ecd-abdf-d496a9999087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed706b67-3f4c-403b-b3d0-4586d680654f', 'volume_name': 'volume-ed706b67-3f4c-403b-b3d0-4586d680654f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d2a350-a3cf-4a01-83ce-edc74f334531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d2a350-a3cf-4a01-83ce-edc74f334531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e103e192-6fc8-4516-9c26-7098f372390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Volume ed706b67-3f4c-403b-b3d0-4586d680654f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed706b67-3f4c-403b-b3d0-4586d680654f', 'volume_size': 1} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Deleted volume successfully. Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 1073741824" returned: 0 in 0.774s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-340f03b2-07b2-42f1-8e84-27913654fd7e tempest-SnapshotMetadataTestJSON-258911399 None] Lock "cinder-7599e28d-d6ca-4f42-bb28-46ff58613b0b-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:21 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 Aug 04 12:28:21 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:21 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99" returned: 0 in 0.525s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2147133117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed706b67-3f4c-403b-b3d0-4586d680654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:21Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b32d916e-f983-4447-91cf-9ec7483a2943),volume_type_id=b32d916e-f983-4447-91cf-9ec7483a2943)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Creating volume ed706b67-3f4c-403b-b3d0-4586d680654f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:21 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb931b48-73f6-496d-be45-91d37170a61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9de95c-4983-4941-b74a-a0e863e16c99', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edaff9a-9e7b-4bb6-a2e1-6a265e1346c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:21 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f 1073741824 Aug 04 12:28:21 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume volume-2f9de95c-4983-4941-b74a-a0e863e16c99 (2f9de95c-4983-4941-b74a-a0e863e16c99): created successfully Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edaff9a-9e7b-4bb6-a2e1-6a265e1346c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (8b85cddb-587f-4614-9d54-b5c548400a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e7d9b967-dc3e-48f4-8b0a-30981a3129a0 tempest-TestInstancesWithCinderVolumes-570869958 None] Created volume successfully. Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (94cae342-ac67-4a59-94d6-43768d7b9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ef25f8-4d01-4bbe-b967-600361fba6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ef25f8-4d01-4bbe-b967-600361fba6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-46120844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68175dc0-6654-4b4e-8716-da3a55fb36d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:22Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2dbc57b-1b28-4416-b730-e1056f1ebc7b),volume_type_id=c2dbc57b-1b28-4416-b730-e1056f1ebc7b)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf57d2f-c8d2-421d-91cc-1b6dc8c7d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf57d2f-c8d2-421d-91cc-1b6dc8c7d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecef5f5-a3ea-4aad-90ee-3dde5bb03a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:28:22 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f 1073741824" returned: 0 in 0.977s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:22 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f Aug 04 12:28:22 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecef5f5-a3ea-4aad-90ee-3dde5bb03a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68175dc0-6654-4b4e-8716-da3a55fb36d2', 'volume_name': 'volume-68175dc0-6654-4b4e-8716-da3a55fb36d2', 'volume_size': 1, 'image_id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1924172819', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a1fdf5af16146b8b3cb02d8eff98e7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'created_at': datetime.datetime(2026, 8, 4, 10, 28, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc7a45f4-2255-432a-b625-5b330951b204/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430cd0f-81b4-4f3e-96af-6750f5be3cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430cd0f-81b4-4f3e-96af-6750f5be3cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe13702-54f1-4128-8aaf-6ffc186b06f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume 68175dc0-6654-4b4e-8716-da3a55fb36d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68175dc0-6654-4b4e-8716-da3a55fb36d2', 'volume_size': 1, 'image_id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1924172819', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a1fdf5af16146b8b3cb02d8eff98e7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'created_at': datetime.datetime(2026, 8, 4, 10, 28, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc7a45f4-2255-432a-b625-5b330951b204/file', 'properties': {}}, 'image_service': } Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Trying to clone 68175dc0-6654-4b4e-8716-da3a55fb36d2 from image fc7a45f4-2255-432a-b625-5b330951b204 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:28:23 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f" returned: 0 in 0.535s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e103e192-6fc8-4516-9c26-7098f372390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed706b67-3f4c-403b-b3d0-4586d680654f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffe4ba7-7a7d-4690-8f0c-c7701bdf1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Volume volume-ed706b67-3f4c-403b-b3d0-4586d680654f (ed706b67-3f4c-403b-b3d0-4586d680654f): created successfully Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffe4ba7-7a7d-4690-8f0c-c7701bdf1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (b1cfce42-d799-44e0-a5de-c80b20b41d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b353b1e-9fd5-4cf8-a8da-541fb6cd5dea tempest-TestInstancesWithCinderVolumes-570869958 None] Created volume successfully. Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Flow 'volume_create_manager' (5b146205-1d1d-4d8d-8977-19f5a0821dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8fd0f3-7bda-4ec3-b8d8-f51f225c41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8fd0f3-7bda-4ec3-b8d8-f51f225c41ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1803015069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c75798-3cf9-44dc-8e2f-881a47ffded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c048cdd7245468d996957cbdc4644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:25Z,use_quota=True,user_id='a9ad495aae1e400d88770ef08b56607a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d9d1ef-9279-4c5b-bca0-0da12d9c5dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d9d1ef-9279-4c5b-bca0-0da12d9c5dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a06d97-cb3f-44d2-920f-4f4c5e4715bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a06d97-cb3f-44d2-920f-4f4c5e4715bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c75798-3cf9-44dc-8e2f-881a47ffded7', 'volume_name': 'volume-95c75798-3cf9-44dc-8e2f-881a47ffded7', 'volume_size': 2}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633f60b0-b69e-4c76-b566-c3d639149835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633f60b0-b69e-4c76-b566-c3d639149835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db84a2-3278-493b-8e83-93807bd5e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Volume 95c75798-3cf9-44dc-8e2f-881a47ffded7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c75798-3cf9-44dc-8e2f-881a47ffded7', 'volume_size': 2} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1803015069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c75798-3cf9-44dc-8e2f-881a47ffded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508c048cdd7245468d996957cbdc4644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:25Z,use_quota=True,user_id='a9ad495aae1e400d88770ef08b56607a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Creating volume 95c75798-3cf9-44dc-8e2f-881a47ffded7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:24 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 2147483648 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:24 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 2147483648 Aug 04 12:28:24 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:25 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 2147483648" returned: 0 in 0.686s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:25 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 Aug 04 12:28:25 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:25 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7" returned: 0 in 0.306s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db84a2-3278-493b-8e83-93807bd5e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c75798-3cf9-44dc-8e2f-881a47ffded7', 'volume_size': 2}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f5ec49-d0c2-4fd0-acbb-0968062e6a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:25 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Volume volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 (95c75798-3cf9-44dc-8e2f-881a47ffded7): created successfully Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f5ec49-d0c2-4fd0-acbb-0968062e6a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Flow 'volume_create_manager' (5b146205-1d1d-4d8d-8977-19f5a0821dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0ae52dd9-2b9e-4aa2-802f-4fb0374a04c5 tempest-VolumesCloneNegativeTest-1902098029 None] Created volume successfully. Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Acquiring lock "cinder-95c75798-3cf9-44dc-8e2f-881a47ffded7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "cinder-95c75798-3cf9-44dc-8e2f-881a47ffded7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Acquiring lock "cinder-quobyte-95c75798-3cf9-44dc-8e2f-881a47ffded7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "cinder-quobyte-95c75798-3cf9-44dc-8e2f-881a47ffded7" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d821964-10d2-438a-9af4-95aefd74069e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:27 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 Aug 04 12:28:27 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD, size 20.69 MB, duration 4.39 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:28:27 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Image download 20.69 MB at 4.71 MB/s Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f662d2c5-5960-4c1a-a2c9-8e713dd6350f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:27 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7" returned: 0 in 0.445s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:27 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7 Aug 04 12:28:27 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:27 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD Aug 04 12:28:27 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:27 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-95c75798-3cf9-44dc-8e2f-881a47ffded7" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "cinder-quobyte-95c75798-3cf9-44dc-8e2f-881a47ffded7" released by "delete_volume" :: held 0.862s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Flow 'volume_create_manager' (34c469a7-0691-4afa-b68f-0faaac44be32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:28 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c8f21-0e9a-4f3f-bbec-fabc84536b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c8f21-0e9a-4f3f-bbec-fabc84536b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787064997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9fbd95-7af2-46d6-a30a-f873f39e4a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28eddf6b0a34a819c1ee6e507ac598c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:28Z,use_quota=True,user_id='ad9838f0972941e582237e90077980b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea773ae-f928-4b7a-8ae7-933e248ed2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea773ae-f928-4b7a-8ae7-933e248ed2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8bad29-1238-4c9e-9b72-e23cb4bc4b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8bad29-1238-4c9e-9b72-e23cb4bc4b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9fbd95-7af2-46d6-a30a-f873f39e4a49', 'volume_name': 'volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3116c91b-7e27-4f39-875e-99a4d818f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3116c91b-7e27-4f39-875e-99a4d818f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c38ba5-8289-46b2-9001-541fa8608d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Volume 4d9fbd95-7af2-46d6-a30a-f873f39e4a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49', 'volume_size': 1} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787064997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9fbd95-7af2-46d6-a30a-f873f39e4a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28eddf6b0a34a819c1ee6e507ac598c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:28Z,use_quota=True,user_id='ad9838f0972941e582237e90077980b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Creating volume 4d9fbd95-7af2-46d6-a30a-f873f39e4a49 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:28 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Temporary image fc7a45f4-2255-432a-b625-5b330951b204 is fetched for user 430eb03c8be541f39d01ac727436c1d1. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:28:28 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 1073741824 Aug 04 12:28:28 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Created reservations ['b6edc65c-adc5-404e-a09b-927821b05af3', 'f842e239-7195-480f-883a-8a8ff750858b', 'c5a45b05-388f-4f53-8328-13ce306f704c', 'fd8e75a6-6702-4cb8-869e-1b00c897529d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b096943-9754-4ad3-875e-fe1f9b0b28c9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:28 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:28 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:28 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD Aug 04 12:28:28 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:28 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:28 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Deleted volume successfully. Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-44e9ada9-d422-4865-96f2-9b78b644ff63 tempest-VolumesCloneNegativeTest-1902098029 None] Lock "cinder-95c75798-3cf9-44dc-8e2f-881a47ffded7-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:28 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 1073741824" returned: 0 in 0.638s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:28 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:28 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 Aug 04 12:28:28 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:29 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-46120844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68175dc0-6654-4b4e-8716-da3a55fb36d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1fdf5af16146b8b3cb02d8eff98e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:22Z,use_quota=True,user_id='430eb03c8be541f39d01ac727436c1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2dbc57b-1b28-4416-b730-e1056f1ebc7b),volume_type_id=c2dbc57b-1b28-4416-b730-e1056f1ebc7b)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Creating volume 68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:29 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c38ba5-8289-46b2-9001-541fa8608d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e6e69e-d4bd-489b-a7c1-475c1a91e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:29 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1073741824 Aug 04 12:28:29 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Volume volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 (4d9fbd95-7af2-46d6-a30a-f873f39e4a49): created successfully Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e6e69e-d4bd-489b-a7c1-475c1a91e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Flow 'volume_create_manager' (34c469a7-0691-4afa-b68f-0faaac44be32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fca1c664-c6b4-438e-859f-cdcb2de76716 tempest-VolumesTransfersV355Test-1065069483 None] Created volume successfully. Aug 04 12:28:29 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1073741824" returned: 0 in 0.540s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:29 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 Aug 04 12:28:29 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:30 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2" returned: 0 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Attempting download of fc7a45f4-2255-432a-b625-5b330951b204 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}])) to volume 68175dc0-6654-4b4e-8716-da3a55fb36d2. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c31c35-e7d1-41f0-a6d4-de910fb39ab7]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:30 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox Aug 04 12:28:30 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:30 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox" returned: 0 in 0.607s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:31 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox Aug 04 12:28:31 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-23dabd22-358b-4d93-87f1-20943dedb614 tempest-VolumesTransfersV355Test-1212327488 None] Transfer volume completed successfully. Aug 04 12:28:31 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox" returned: 1 in 0.583s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc7a45f4-2255-432a-b625-5b330951b204__sw4ubox' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb06c5-aa89-4e62-b42f-a630fd81d2cd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:31 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD Aug 04 12:28:31 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:31 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] fc7a45f4-2255-432a-b625-5b330951b204 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:28:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:32 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 Aug 04 12:28:32 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "cinder-4d9fbd95-7af2-46d6-a30a-f873f39e4a49-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-4d9fbd95-7af2-46d6-a30a-f873f39e4a49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "cinder-quobyte-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-quobyte-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4baf0-21f6-426d-b231-909049a0b5f9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:32 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 Aug 04 12:28:32 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:33 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" returned: 0 in 0.551s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:33 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49 Aug 04 12:28:33 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:33 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (76e4f8a6-d7a4-43e5-8c1b-3a861e40cd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdd8a93-0653-42a2-bba0-5301c6a606c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" returned: 0 in 0.399s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdd8a93-0653-42a2-bba0-5301c6a606c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-366565920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f67bb5-5c89-4786-a142-42d3f9c0c430,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:33Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999512fa-72ae-4a8a-a06f-80b6386ff157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999512fa-72ae-4a8a-a06f-80b6386ff157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b466e8-cca1-4c8a-b8eb-853ba6144221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b466e8-cca1-4c8a-b8eb-853ba6144221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f67bb5-5c89-4786-a142-42d3f9c0c430', 'volume_name': 'volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a8334-2077-40ae-9bc1-da12601497a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a8334-2077-40ae-9bc1-da12601497a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b786d3-a85d-46bf-8d44-a0707e26a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Volume e5f67bb5-5c89-4786-a142-42d3f9c0c430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430', 'volume_size': 1} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-366565920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f67bb5-5c89-4786-a142-42d3f9c0c430,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:33Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Creating volume e5f67bb5-5c89-4786-a142-42d3f9c0c430 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:33 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-quobyte-4d9fbd95-7af2-46d6-a30a-f873f39e4a49" released by "delete_volume" :: held 1.097s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:33 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 1073741824 Aug 04 12:28:33 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Created reservations ['673d12f7-a541-4452-96bb-2b95750163bb', 'f6f5daee-8741-47b0-8e87-6ef96d1bdfaf', '3f95e3de-a584-4add-9557-8c1778cbf51a', '16d90c5c-1c01-4948-a03e-90cccd0c24a0'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:33 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:33 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:34 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.532s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Deleted volume successfully. Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-bf46c356-9138-4e28-a637-c4d2ea5db521 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-4d9fbd95-7af2-46d6-a30a-f873f39e4a49-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:34 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 1073741824" returned: 0 in 1.015s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:34 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 Aug 04 12:28:34 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:34 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2" returned: 0 in 2.843s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc7a45f4-2255-432a-b625-5b330951b204_2dlnwn1adevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:28:34 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Converted 112.00 MB image at 39.38 MB/s Aug 04 12:28:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:34 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1G Aug 04 12:28:34 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:35 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430" returned: 0 in 0.420s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b786d3-a85d-46bf-8d44-a0707e26a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ba908-e05e-4ecf-87cf-e213bc048452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Volume volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 (e5f67bb5-5c89-4786-a142-42d3f9c0c430): created successfully Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ba908-e05e-4ecf-87cf-e213bc048452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (76e4f8a6-d7a4-43e5-8c1b-3a861e40cd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0203adbe-79c1-45ea-8432-659450e76ff6 tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:28:35 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 1G" returned: 0 in 0.552s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Downloaded image fc7a45f4-2255-432a-b625-5b330951b204 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}])) to volume 68175dc0-6654-4b4e-8716-da3a55fb36d2 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Temporary image fc7a45f4-2255-432a-b625-5b330951b204 for user 430eb03c8be541f39d01ac727436c1d1 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Marking volume 68175dc0-6654-4b4e-8716-da3a55fb36d2 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Copying metadata from image fc7a45f4-2255-432a-b625-5b330951b204 to 68175dc0-6654-4b4e-8716-da3a55fb36d2. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Creating volume glance metadata for volume 68175dc0-6654-4b4e-8716-da3a55fb36d2 backed by image fc7a45f4-2255-432a-b625-5b330951b204 with: {'image_id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'image_name': 'tempest-scenario-img--1924172819', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe13702-54f1-4128-8aaf-6ffc186b06f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68175dc0-6654-4b4e-8716-da3a55fb36d2', 'volume_size': 1, 'image_id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc7a45f4-2255-432a-b625-5b330951b204', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1924172819', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a1fdf5af16146b8b3cb02d8eff98e7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc7a45f4-2255-432a-b625-5b330951b204', 'created_at': datetime.datetime(2026, 8, 4, 10, 28, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc7a45f4-2255-432a-b625-5b330951b204/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1541c788-52b3-4179-aaee-c4d9b2ae48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Volume volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 (68175dc0-6654-4b4e-8716-da3a55fb36d2): created successfully Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1541c788-52b3-4179-aaee-c4d9b2ae48ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Flow 'volume_create_manager' (94cae342-ac67-4a59-94d6-43768d7b9149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-76c73ab6-73d6-4706-80d4-098127ec7566 tempest-TestInstancesWithCinderVolumes-570869958 None] Created volume successfully. Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Flow 'volume_create_manager' (0c82c29e-9a6f-4f97-9ef8-ee5725a89e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12af77d7-eb7f-4f76-b275-0b147411063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12af77d7-eb7f-4f76-b275-0b147411063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-373609231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efc727d-1ba1-4eee-9726-cf33ed09772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28eddf6b0a34a819c1ee6e507ac598c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:36Z,use_quota=True,user_id='ad9838f0972941e582237e90077980b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974f3fa3-a9e3-4a28-8a4e-1880b76caf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974f3fa3-a9e3-4a28-8a4e-1880b76caf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0812138-170a-4e08-b805-7c82bbde3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0812138-170a-4e08-b805-7c82bbde3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efc727d-1ba1-4eee-9726-cf33ed09772c', 'volume_name': 'volume-5efc727d-1ba1-4eee-9726-cf33ed09772c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13adcd3b-0069-474a-bab7-fc08706045e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13adcd3b-0069-474a-bab7-fc08706045e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047b5fb-3ad2-4ed9-9367-f8de05b1b370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Volume 5efc727d-1ba1-4eee-9726-cf33ed09772c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efc727d-1ba1-4eee-9726-cf33ed09772c', 'volume_size': 1} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-373609231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efc727d-1ba1-4eee-9726-cf33ed09772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28eddf6b0a34a819c1ee6e507ac598c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:36Z,use_quota=True,user_id='ad9838f0972941e582237e90077980b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Creating volume 5efc727d-1ba1-4eee-9726-cf33ed09772c {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:35 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:35 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c 1073741824 Aug 04 12:28:35 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:36 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c 1073741824" returned: 0 in 0.646s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (374e5d0c-f6ff-403d-b73e-eb80a5700536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e862436-b8ca-42a9-84fe-2fffc4943a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e862436-b8ca-42a9-84fe-2fffc4943a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-750454912',display_name='tempest-VolumesGetTest-Volume-211706388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2333ebfb-c8e7-4474-9572-cb63b81b4b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:36Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:36 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c Aug 04 12:28:36 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7effa4-72e4-42ce-9cd6-98e7bfc3a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7effa4-72e4-42ce-9cd6-98e7bfc3a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b6114-8d6d-4a9d-81de-d36cc191f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b6114-8d6d-4a9d-81de-d36cc191f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2333ebfb-c8e7-4474-9572-cb63b81b4b35', 'volume_name': 'volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf52c81-063f-454c-8317-628fb8f52220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf52c81-063f-454c-8317-628fb8f52220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882c9dc9-3499-4143-8f78-0b54e12d4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:36 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Volume 2333ebfb-c8e7-4474-9572-cb63b81b4b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35', 'volume_size': 1} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:36 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c" returned: 0 in 0.422s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-750454912',display_name='tempest-VolumesGetTest-Volume-211706388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2333ebfb-c8e7-4474-9572-cb63b81b4b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:36Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Creating volume 2333ebfb-c8e7-4474-9572-cb63b81b4b35 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:36 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047b5fb-3ad2-4ed9-9367-f8de05b1b370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efc727d-1ba1-4eee-9726-cf33ed09772c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:37 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 1073741824 Aug 04 12:28:37 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12666dce-4fdc-4949-95d7-fed6cf5e311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Volume volume-5efc727d-1ba1-4eee-9726-cf33ed09772c (5efc727d-1ba1-4eee-9726-cf33ed09772c): created successfully Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12666dce-4fdc-4949-95d7-fed6cf5e311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Flow 'volume_create_manager' (0c82c29e-9a6f-4f97-9ef8-ee5725a89e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-415e88cb-9ba6-4cd4-8f64-9e3ff387b4a9 tempest-VolumesTransfersV355Test-1065069483 None] Created volume successfully. Aug 04 12:28:37 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 1073741824" returned: 0 in 0.808s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:37 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 Aug 04 12:28:37 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "cinder-5efc727d-1ba1-4eee-9726-cf33ed09772c-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-5efc727d-1ba1-4eee-9726-cf33ed09772c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:38 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35" returned: 0 in 0.444s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882c9dc9-3499-4143-8f78-0b54e12d4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bd68d6-eb54-4d1a-bcd9-9cc751771803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "cinder-quobyte-5efc727d-1ba1-4eee-9726-cf33ed09772c" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Volume volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 (2333ebfb-c8e7-4474-9572-cb63b81b4b35): created successfully Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bd68d6-eb54-4d1a-bcd9-9cc751771803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (374e5d0c-f6ff-403d-b73e-eb80a5700536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-quobyte-5efc727d-1ba1-4eee-9726-cf33ed09772c" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-aff78e59-ccad-48a4-8649-a9656d438f54 tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721e775-56fb-4265-a573-ae3aed67d39a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:38 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c Aug 04 12:28:38 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-2333ebfb-c8e7-4474-9572-cb63b81b4b35-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "cinder-2333ebfb-c8e7-4474-9572-cb63b81b4b35-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:39 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c" returned: 0 in 0.749s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:39 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c Aug 04 12:28:39 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-2333ebfb-c8e7-4474-9572-cb63b81b4b35" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-2333ebfb-c8e7-4474-9572-cb63b81b4b35" acquired by "delete_volume" :: waited 0.060s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702cd0f-273e-400a-ad4b-62ec2406997e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:39 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5efc727d-1ba1-4eee-9726-cf33ed09772c" returned: 0 in 0.439s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:39 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 Aug 04 12:28:39 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-quobyte-5efc727d-1ba1-4eee-9726-cf33ed09772c" released by "delete_volume" :: held 1.267s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Created reservations ['a8de20ac-29ea-49b7-ab76-d0f199e1bacc', '2ea3e9dc-ed0f-4c29-a98d-685ee7bbcfde', '08f1b8d6-aa9b-4cc4-b2be-b0b604f4d40b', '1d4d1c47-2f2e-4a17-9ac7-d6fcdef5f7bc'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:39 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:39 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:40 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35" returned: 0 in 0.651s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:40 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35 Aug 04 12:28:40 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:40 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Deleted volume successfully. Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c578dd24-70f4-40f4-a6e6-9a4510f58583 tempest-VolumesTransfersV355Test-827188946 None] Lock "cinder-5efc727d-1ba1-4eee-9726-cf33ed09772c-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:40 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2333ebfb-c8e7-4474-9572-cb63b81b4b35" returned: 0 in 0.700s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-2333ebfb-c8e7-4474-9572-cb63b81b4b35" released by "delete_volume" :: held 1.449s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:40 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Created reservations ['0dd1b578-659d-475c-aab1-015d00ea0633', '1a4c110e-1844-44c4-ac3c-f800fc6990ce', '7300774c-14d7-4923-bcf6-21a050f61df9', '0f438b28-579b-42ac-a3f0-9c2fb97b821d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:41 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:41 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-3dc6394a-ca07-4375-ac9e-13ae0a351d76 req-52434e13-f1c8-46b0-834c-c7a60a25c066 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-3dc6394a-ca07-4375-ac9e-13ae0a351d76 req-52434e13-f1c8-46b0-834c-c7a60a25c066 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-3dc6394a-ca07-4375-ac9e-13ae0a351d76 req-52434e13-f1c8-46b0-834c-c7a60a25c066 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-3dc6394a-ca07-4375-ac9e-13ae0a351d76 req-52434e13-f1c8-46b0-834c-c7a60a25c066 tempest-TestInstancesWithCinderVolumes-570869958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-68175dc0-6654-4b4e-8716-da3a55fb36d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ee03bf6-ec82-4be1-b0de-b72a4b6d737e', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:28:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-3dc6394a-ca07-4375-ac9e-13ae0a351d76 req-52434e13-f1c8-46b0-834c-c7a60a25c066 tempest-TestInstancesWithCinderVolumes-570869958 None] attachment_update completed successfully. Aug 04 12:28:41 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.500s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-660e9bdd-7e77-4946-aa10-589e16be8c06 tempest-VolumesGetTest-148728238 None] Lock "cinder-2333ebfb-c8e7-4474-9572-cb63b81b4b35-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-e5f67bb5-5c89-4786-a142-42d3f9c0c430-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "cinder-e5f67bb5-5c89-4786-a142-42d3f9c0c430-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-e5f67bb5-5c89-4786-a142-42d3f9c0c430" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-e5f67bb5-5c89-4786-a142-42d3f9c0c430" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[869b4122-9eff-45ca-b99d-b27f300a514a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:42 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 Aug 04 12:28:42 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:42 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430" returned: 0 in 0.735s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:42 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430 Aug 04 12:28:42 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:42 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e5f67bb5-5c89-4786-a142-42d3f9c0c430" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-e5f67bb5-5c89-4786-a142-42d3f9c0c430" released by "delete_volume" :: held 1.129s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:42 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Created reservations ['31e0f837-11d2-4cca-91df-bc2dd09fa581', 'c548c4f1-88f8-4e6e-a7e5-56d8aa064754', '4472c1e9-bdf2-4575-a7bd-b4382c63a0b9', 'bd693755-c5f6-4c8e-af14-47029877aac3'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:43 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:28:43 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:43 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.414s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:28:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:28:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c5202a5-a0bf-4658-bed5-014a379053fc tempest-VolumesGetTest-148728238 None] Lock "cinder-e5f67bb5-5c89-4786-a142-42d3f9c0c430-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (0672973c-47d9-4a60-9685-4ba997482c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6324f0e3-2fd7-4358-bb67-942c13340a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6324f0e3-2fd7-4358-bb67-942c13340a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-613263252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a845bf6-cdec-478b-be42-f22a432be5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:45Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825b327-5c68-40dd-a183-2bd25219c0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825b327-5c68-40dd-a183-2bd25219c0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b93950a-919d-4f2e-9509-23b1bedf6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b93950a-919d-4f2e-9509-23b1bedf6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a845bf6-cdec-478b-be42-f22a432be5ff', 'volume_name': 'volume-2a845bf6-cdec-478b-be42-f22a432be5ff', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4328799f-8bf4-40b4-a078-acf6e59b1f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4328799f-8bf4-40b4-a078-acf6e59b1f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149c7900-07da-4da1-8485-4c6e1f5bc676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Volume 2a845bf6-cdec-478b-be42-f22a432be5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a845bf6-cdec-478b-be42-f22a432be5ff', 'volume_size': 1} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-613263252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a845bf6-cdec-478b-be42-f22a432be5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:45Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Creating volume 2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:28:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:28:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:45 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff 1073741824 Aug 04 12:28:45 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:46 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff 1073741824" returned: 0 in 1.150s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:46 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:28:46 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:46 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.552s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149c7900-07da-4da1-8485-4c6e1f5bc676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a845bf6-cdec-478b-be42-f22a432be5ff', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d54cf-ca74-4caa-9e6a-fc4ff601f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Volume volume-2a845bf6-cdec-478b-be42-f22a432be5ff (2a845bf6-cdec-478b-be42-f22a432be5ff): created successfully Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d54cf-ca74-4caa-9e6a-fc4ff601f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (0672973c-47d9-4a60-9685-4ba997482c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5084a1b8-098f-4beb-866c-99765a1741ca tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (0250b904-b961-467d-8266-2063b8e0692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aa2d02-aa38-4199-bcf4-76110c29354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aa2d02-aa38-4199-bcf4-76110c29354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-799273756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53f1b69-a9b2-4810-b2ad-b21ba9c795b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2a845bf6-cdec-478b-be42-f22a432be5ff,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:49Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae91211-d053-40ba-8875-7cc37ffb1e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae91211-d053-40ba-8875-7cc37ffb1e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56037825-67ee-420a-8f18-32cda4715755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56037825-67ee-420a-8f18-32cda4715755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c53f1b69-a9b2-4810-b2ad-b21ba9c795b8', 'volume_name': 'volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8', 'volume_size': 1, 'source_volid': '2a845bf6-cdec-478b-be42-f22a432be5ff', 'source_volstatus': 'available'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583fa491-8661-4b6b-8f6c-49ede5625701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583fa491-8661-4b6b-8f6c-49ede5625701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390bf715-83ad-4ec9-86a5-4fac1a895e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:49 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Volume c53f1b69-a9b2-4810-b2ad-b21ba9c795b8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8', 'volume_size': 1, 'source_volid': '2a845bf6-cdec-478b-be42-f22a432be5ff', 'source_volstatus': 'available'} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:49 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Cloning volume 2a845bf6-cdec-478b-be42-f22a432be5ff to volume c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Creating offline snapshot 5d4f8989-2417-40bb-8f79-07c5f012abfe of volume 2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2a74b5-854c-4496-bdaa-1be61d27a177]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:49 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:28:49 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:50 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.762s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:50 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe 1G Aug 04 12:28:50 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:50 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe 1G" returned: 0 in 0.632s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a845bf6-cdec-478b-be42-f22a432be5ff -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:50 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a845bf6-cdec-478b-be42-f22a432be5ff -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:28:50 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:51 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a845bf6-cdec-478b-be42-f22a432be5ff -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.488s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:51 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe is being set with open permissions: ugo+rw Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:51 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:28:51 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:51 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.438s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=96,cinder:UPDATE=95,cinder:INSERT=28,cinder:DELETE=10 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=88,cinder:UPDATE=109,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Flow 'volume_create_manager' (6071012a-6fbb-4557-acff-fcb1a6ffecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5590f3-6790-4858-8cd4-ebc14376abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:51 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info Aug 04 12:28:51 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5590f3-6790-4858-8cd4-ebc14376abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-747906936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e36799-d55c-430b-a6ca-86de7cdbda1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ad18fef4564bd8832f4380748ed4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:52Z,use_quota=True,user_id='b3165d70c9374dc88f63b53bf2037745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66af752-c67d-4f72-9d9a-46c07b2166c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66af752-c67d-4f72-9d9a-46c07b2166c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4217aacb-fe63-4803-bad4-c0f41165af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:51 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:28:52 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info" returned: 0 in 0.423s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:52 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info is being set with open permissions: ugo+rw Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:52 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info Aug 04 12:28:52 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4217aacb-fe63-4803-bad4-c0f41165af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37e36799-d55c-430b-a6ca-86de7cdbda1c', 'volume_name': 'volume-37e36799-d55c-430b-a6ca-86de7cdbda1c', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7eda1c5-8434-492a-896a-c0bdaa843c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7eda1c5-8434-492a-896a-c0bdaa843c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ed48e2-704d-4e0a-b716-f83ad6cd531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:28:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Volume 37e36799-d55c-430b-a6ca-86de7cdbda1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37e36799-d55c-430b-a6ca-86de7cdbda1c', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Trying to clone 37e36799-d55c-430b-a6ca-86de7cdbda1c from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:28:52 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.info" returned: 0 in 0.516s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] snapshot: 5d4f8989-2417-40bb-8f79-07c5f012abfe, volume: c53f1b69-a9b2-4810-b2ad-b21ba9c795b8, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6eee2a-e73c-4da7-8161-3e34bae710b9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:28:52 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Image download 20.69 MB at 20.69 MB/s Aug 04 12:28:52 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:28:52 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd68d66-fca6-4e9b-a150-44462ec02302]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:53 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD Aug 04 12:28:53 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:53 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.526s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a845bf6-cdec-478b-be42-f22a432be5ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee10a2-9a26-4591-9890-100f45e9a67b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:53 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 is fetched for user b3165d70c9374dc88f63b53bf2037745. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:28:53 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:28:53 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c59bfc-be2c-4737-b0dc-82e30aaa4733]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:28:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:53 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD Aug 04 12:28:53 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:54 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.816s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:28:54 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 Aug 04 12:28:54 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD" returned: 0 in 0.571s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:28:54 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:28:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:01 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" returned: 0 in 7.466s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:01 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:29:01 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Converted 1024.00 MB image at 137.13 MB/s Aug 04 12:29:01 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 is being set with open permissions: ugo+rw Aug 04 12:29:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:01 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 Aug 04 12:29:01 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:02 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" returned: 0 in 0.429s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" released by "_copy_volume_from_snapshot" :: held 9.366s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-5d4f8989-2417-40bb-8f79-07c5f012abfe" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-5d4f8989-2417-40bb-8f79-07c5f012abfe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Deleting offline snapshot 5d4f8989-2417-40bb-8f79-07c5f012abfe of volume 2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] snapshot_file for this snap is: volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec33d71-6a44-4932-ad94-55c0e1c2f9ac]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (39d57cfc-2256-4d01-8021-8f64e1e3f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fee6c9a-8b44-481d-8a7c-8b606b68daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fee6c9a-8b44-481d-8a7c-8b606b68daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1499604132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f40ae6-9f1b-46e9-88c2-2906f899074a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:02Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b189be-8951-4937-b61d-d1e65833b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b189be-8951-4937-b61d-d1e65833b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879bf48c-f07d-4d2f-b2b9-19e63f4e5b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:02 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:29:02 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879bf48c-f07d-4d2f-b2b9-19e63f4e5b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f40ae6-9f1b-46e9-88c2-2906f899074a', 'volume_name': 'volume-49f40ae6-9f1b-46e9-88c2-2906f899074a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbdf807-820f-48a6-95cb-a043cd33f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbdf807-820f-48a6-95cb-a043cd33f222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa96c5f-9fa1-4fb8-bfd1-b2785a4211d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:02 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Volume 49f40ae6-9f1b-46e9-88c2-2906f899074a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f40ae6-9f1b-46e9-88c2-2906f899074a', 'volume_size': 1} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:02 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.581s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a845bf6-cdec-478b-be42-f22a432be5ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132efee-b0c0-4fe1-b157-3d3b5c0a9b97]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:02 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:29:02 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:03 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.586s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:03 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:29:03 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:03 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:03 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe Aug 04 12:29:03 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:03 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff.5d4f8989-2417-40bb-8f79-07c5f012abfe" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-5d4f8989-2417-40bb-8f79-07c5f012abfe" released by "_delete_snapshot" :: held 1.887s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.831s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.806s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-747906936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e36799-d55c-430b-a6ca-86de7cdbda1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ad18fef4564bd8832f4380748ed4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:28:52Z,use_quota=True,user_id='b3165d70c9374dc88f63b53bf2037745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Creating volume 37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:04 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390bf715-83ad-4ec9-86a5-4fac1a895e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8', 'volume_size': 1, 'source_volid': '2a845bf6-cdec-478b-be42-f22a432be5ff', 'source_volstatus': 'available'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:04 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1073741824 Aug 04 12:29:04 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37cabac-a4d9-4350-a399-be78b4466e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Volume volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 (c53f1b69-a9b2-4810-b2ad-b21ba9c795b8): created successfully Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37cabac-a4d9-4350-a399-be78b4466e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (0250b904-b961-467d-8266-2063b8e0692c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b6d8db79-a9a5-4a8a-a3c0-de42e0fff64a tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:29:04 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1073741824" returned: 0 in 0.482s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:04 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c Aug 04 12:29:04 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:04 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1499604132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f40ae6-9f1b-46e9-88c2-2906f899074a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4629707df29c408f9e162537c70f6748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:02Z,use_quota=True,user_id='369393af74024232b1e241688b4d5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Creating volume 49f40ae6-9f1b-46e9-88c2-2906f899074a {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:04 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:04 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a 1073741824 Aug 04 12:29:04 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Attempting download of 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume 37e36799-d55c-430b-a6ca-86de7cdbda1c. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e69c780-6803-4de1-b51f-501b698aa9e2]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:05 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8 Aug 04 12:29:05 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:05 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8" returned: 0 in 0.496s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:05 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a 1073741824" returned: 0 in 0.689s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:05 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8 Aug 04 12:29:05 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:05 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a Aug 04 12:29:05 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:05 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:05 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa96c5f-9fa1-4fb8-bfd1-b2785a4211d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f40ae6-9f1b-46e9-88c2-2906f899074a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd44c73-1abb-4d3f-85da-5e3c90e8ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8" returned: 1 in 0.515s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_b21z1qz8' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755bce6-6961-4e8e-bdd5-7de94183c910]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Volume volume-49f40ae6-9f1b-46e9-88c2-2906f899074a (49f40ae6-9f1b-46e9-88c2-2906f899074a): created successfully Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd44c73-1abb-4d3f-85da-5e3c90e8ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Flow 'volume_create_manager' (39d57cfc-2256-4d01-8021-8f64e1e3f78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-78391b4f-386d-4f30-9d86-457269b2f00c tempest-AttachVolumeNegativeTest-22382868 None] Created volume successfully. Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (589f2b32-08c4-4c06-a40c-757d7f92d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884baea-1021-4320-9149-b2107c29cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884baea-1021-4320-9149-b2107c29cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1423026151',display_name='tempest-VolumesGetTest-Volume-1971842299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5fe86-d8cf-48e0-b607-3ae4044f6b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:06Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eeede6-301e-4cf1-a1d7-59df582dc539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eeede6-301e-4cf1-a1d7-59df582dc539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c16b5c-44eb-4801-a51b-916d0dca6623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c16b5c-44eb-4801-a51b-916d0dca6623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f5fe86-d8cf-48e0-b607-3ae4044f6b12', 'volume_name': 'volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f2b84e-6b58-4109-8a0c-f5a6476acc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f2b84e-6b58-4109-8a0c-f5a6476acc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dbe976-3329-4726-8452-9a4aa745d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Volume 74f5fe86-d8cf-48e0-b607-3ae4044f6b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12', 'volume_size': 1} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:06 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD Aug 04 12:29:06 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1423026151',display_name='tempest-VolumesGetTest-Volume-1971842299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5fe86-d8cf-48e0-b607-3ae4044f6b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:06Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Creating volume 74f5fe86-d8cf-48e0-b607-3ae4044f6b12 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:06 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:06 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 1073741824 Aug 04 12:29:06 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:06 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:06 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:06 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD" returned: 0 in 0.508s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:06 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c Aug 04 12:29:06 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:06 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.371s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 28 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:29:06 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 1073741824" returned: 0 in 0.595s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:06 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 Aug 04 12:29:06 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:07 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dbe976-3329-4726-8452-9a4aa745d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4e2edf-a8b9-4984-ab19-8595b181d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:07 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Volume volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 (74f5fe86-d8cf-48e0-b607-3ae4044f6b12): created successfully Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4e2edf-a8b9-4984-ab19-8595b181d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (589f2b32-08c4-4c06-a40c-757d7f92d531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7ee1b548-7ff3-411a-a772-bc3465249a99 tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-780c2ad3-2553-4b48-b64b-b9857ec62048 req-0cc1e231-2b49-4680-a4a5-8ea054d367ae tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-780c2ad3-2553-4b48-b64b-b9857ec62048 req-0cc1e231-2b49-4680-a4a5-8ea054d367ae tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-780c2ad3-2553-4b48-b64b-b9857ec62048 req-0cc1e231-2b49-4680-a4a5-8ea054d367ae tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-780c2ad3-2553-4b48-b64b-b9857ec62048 req-0cc1e231-2b49-4680-a4a5-8ea054d367ae tempest-AttachVolumeNegativeTest-22382868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-49f40ae6-9f1b-46e9-88c2-2906f899074a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2341834e-3057-4c60-9d66-5d516599d783', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:29:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-780c2ad3-2553-4b48-b64b-b9857ec62048 req-0cc1e231-2b49-4680-a4a5-8ea054d367ae tempest-AttachVolumeNegativeTest-22382868 None] attachment_update completed successfully. Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-74f5fe86-d8cf-48e0-b607-3ae4044f6b12-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "cinder-74f5fe86-d8cf-48e0-b607-3ae4044f6b12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[588498d7-83c8-4aa6-aca6-343d660fb7e1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:08 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c" returned: 0 in 2.044s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_12mpdvk1devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:29:08 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Converted 112.00 MB image at 54.77 MB/s Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:08 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1G Aug 04 12:29:08 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:08 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 Aug 04 12:29:08 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:08 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 1G" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Downloaded image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume 37e36799-d55c-430b-a6ca-86de7cdbda1c successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:29:08 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 for user b3165d70c9374dc88f63b53bf2037745 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Marking volume 37e36799-d55c-430b-a6ca-86de7cdbda1c as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Copying metadata from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 to 37e36799-d55c-430b-a6ca-86de7cdbda1c. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Creating volume glance metadata for volume 37e36799-d55c-430b-a6ca-86de7cdbda1c backed by image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:29:08 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12 Aug 04 12:29:08 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ed48e2-704d-4e0a-b716-f83ad6cd531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e36799-d55c-430b-a6ca-86de7cdbda1c', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bef663-a814-4c2c-b7a1-eecf9fe029b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:09 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Volume volume-37e36799-d55c-430b-a6ca-86de7cdbda1c (37e36799-d55c-430b-a6ca-86de7cdbda1c): created successfully Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bef663-a814-4c2c-b7a1-eecf9fe029b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Flow 'volume_create_manager' (6071012a-6fbb-4557-acff-fcb1a6ffecf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9e329797-eaa0-4bc9-ba6e-5ccf93d1db76 tempest-VolumesExtendTest-103976108 None] Created volume successfully. Aug 04 12:29:09 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-74f5fe86-d8cf-48e0-b607-3ae4044f6b12" released by "delete_volume" :: held 0.697s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Created reservations ['25803fc4-bd53-485d-81f2-5d8b3031b4a7', '0052c1d4-0af7-405f-b88f-7a9f1865a48f', '7aaa6968-affb-4256-897d-665e3cb42283', '5e9ae53a-7bda-40c7-84bb-79f43b0539d6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:09 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:09 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:09 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.309s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec6db1ec-f692-4b57-a20e-e73a1df1b0f6 tempest-VolumesGetTest-148728238 None] Lock "cinder-74f5fe86-d8cf-48e0-b607-3ae4044f6b12-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d3018-57df-4881-988c-46f14bba3a1a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "cinder-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:09 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c Aug 04 12:29:09 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b67f15-20df-4556-87ab-ee5b5450e9b3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:09 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 Aug 04 12:29:09 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:10 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c" returned: 0 in 0.438s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 2G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c 2G" returned: 0 in 0.104s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.579s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:10 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" returned: 0 in 0.419s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c9d5a4ff-918f-4492-9b7f-9fc3313b6db1 tempest-VolumesExtendTest-103976108 None] Extend volume completed successfully. Aug 04 12:29:10 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8 Aug 04 12:29:10 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-364786f5-94dc-4d14-a9c6-1a7d3c71cc6d req-9a92b025-30de-43b1-9a63-914b5f9f6a8a tempest-AttachVolumeNegativeTest-22382868 None] Terminate volume connection completed successfully. Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-364786f5-94dc-4d14-a9c6-1a7d3c71cc6d req-9a92b025-30de-43b1-9a63-914b5f9f6a8a tempest-AttachVolumeNegativeTest-22382868 None] Deleting attachment 2341834e-3057-4c60-9d66-5d516599d783. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:29:10 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" returned: 0 in 0.286s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8" released by "delete_volume" :: held 0.761s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Created reservations ['92c77f64-6c71-47b7-94e1-d3173e0a14b2', 'd1288b06-98cc-4b7d-a041-5c6b0b0a8f31', '4bfedd8c-c9b7-4b9e-9757-7f7af6ff491c', '4fdaa9cc-f734-4801-9264-ab1514b69051'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:10 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:10 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-37e36799-d55c-430b-a6ca-86de7cdbda1c-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:10 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:10 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "cinder-37e36799-d55c-430b-a6ca-86de7cdbda1c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-2a845bf6-cdec-478b-be42-f22a432be5ff-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-00ad6fcf-e72f-4a81-9b52-3393804a656e tempest-VolumesGetTest-148728238 None] Lock "cinder-c53f1b69-a9b2-4810-b2ad-b21ba9c795b8-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "cinder-2a845bf6-cdec-478b-be42-f22a432be5ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-quobyte-37e36799-d55c-430b-a6ca-86de7cdbda1c" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-37e36799-d55c-430b-a6ca-86de7cdbda1c" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-2a845bf6-cdec-478b-be42-f22a432be5ff" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab708af-17dc-4ece-93cc-3a43af20e12e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-2a845bf6-cdec-478b-be42-f22a432be5ff" acquired by "delete_volume" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79bd5b-bb07-4bb5-9501-a19386c4d4fb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:11 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c Aug 04 12:29:11 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:11 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:29:11 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:11 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c" returned: 0 in 0.483s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:11 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.428s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:11 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c Aug 04 12:29:11 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:11 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff Aug 04 12:29:11 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:11 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37e36799-d55c-430b-a6ca-86de7cdbda1c" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:12 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-37e36799-d55c-430b-a6ca-86de7cdbda1c" released by "delete_volume" :: held 0.906s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a845bf6-cdec-478b-be42-f22a432be5ff" returned: 0 in 0.377s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-2a845bf6-cdec-478b-be42-f22a432be5ff" released by "delete_volume" :: held 0.884s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Created reservations ['fae71aba-a42e-4486-b60a-a6785189f5bd', '91d02e4c-2252-410b-aa0a-7664801e17ab', '1962eb38-ab06-432c-90e6-99bf068ad41f', 'd40f9448-a458-4b24-a49c-49623574cb5b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Created reservations ['43abf888-7962-4638-aa85-c77f94d3195f', 'c493938a-effa-4a32-98b2-3dc13ffd6767', 'a33d8be2-e6fa-42d3-a24a-e0aec96d0311', '7e3b4705-ee16-4e63-ae6b-dda12df9440c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:12 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:12 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:12 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:12 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:12 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:12 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.399s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.348s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Deleted volume successfully. Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7a4edfef-4cfd-41d1-8b83-3a4c86e1350a tempest-VolumesExtendTest-103976108 None] Lock "cinder-37e36799-d55c-430b-a6ca-86de7cdbda1c-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:29:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-32f9985b-3e7a-44a9-8cf8-42407fa6539e tempest-VolumesGetTest-148728238 None] Lock "cinder-2a845bf6-cdec-478b-be42-f22a432be5ff-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (936b1a72-d6d6-42dc-b199-d9681fe53af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b228287b-a26c-4007-9051-213d794647d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b228287b-a26c-4007-9051-213d794647d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1075959922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6df3f2-ebcd-4856-a519-931ddf886567,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:13Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7ee1a3-b172-4538-bcfe-a08918ab2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7ee1a3-b172-4538-bcfe-a08918ab2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8dcf5e-5c31-4309-963f-86763037aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8dcf5e-5c31-4309-963f-86763037aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac6df3f2-ebcd-4856-a519-931ddf886567', 'volume_name': 'volume-ac6df3f2-ebcd-4856-a519-931ddf886567', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35f11b0-01ca-4c4a-97fd-88d9725e2f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35f11b0-01ca-4c4a-97fd-88d9725e2f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabe6458-842d-4353-b0b6-812d8f0e1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:13 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Volume ac6df3f2-ebcd-4856-a519-931ddf886567: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac6df3f2-ebcd-4856-a519-931ddf886567', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 04 12:29:13 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Trying to clone ac6df3f2-ebcd-4856-a519-931ddf886567 from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Flow 'volume_create_manager' (4335aca8-b0cb-4c9a-8811-83bb091d2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026088dd-3101-4d52-a45e-63dca171f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026088dd-3101-4d52-a45e-63dca171f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1010851066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3b8bf-3d56-41b9-9b0d-37081d4084eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ad18fef4564bd8832f4380748ed4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:14Z,use_quota=True,user_id='b3165d70c9374dc88f63b53bf2037745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b62e5ed-6d17-4297-b377-ef201808ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b62e5ed-6d17-4297-b377-ef201808ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7559cd46-c286-4ac0-8cee-dda655878bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7559cd46-c286-4ac0-8cee-dda655878bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab3b8bf-3d56-41b9-9b0d-37081d4084eb', 'volume_name': 'volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3569cc2-16b1-42e3-9398-d668b1fea9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3569cc2-16b1-42e3-9398-d668b1fea9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78eba29-bb95-4c5d-bfed-c22a099349d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:14 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Volume 4ab3b8bf-3d56-41b9-9b0d-37081d4084eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb', 'volume_size': 1} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1010851066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3b8bf-3d56-41b9-9b0d-37081d4084eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ad18fef4564bd8832f4380748ed4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:14Z,use_quota=True,user_id='b3165d70c9374dc88f63b53bf2037745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Creating volume 4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:14 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:29:14 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Image download 20.69 MB at 20.69 MB/s Aug 04 12:29:14 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb 1073741824 Aug 04 12:29:14 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[54804261-eff5-4163-b4e1-9d30d409c681]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:14 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD Aug 04 12:29:14 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:14 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb 1073741824" returned: 0 in 0.580s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:14 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 is fetched for user 695a6896fe6b4a458dcc65377b6f3947. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:29:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:15 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:15 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[27714ed0-0428-4316-a0e0-c40854ca95da]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:15 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD Aug 04 12:29:15 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:15 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.289s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78eba29-bb95-4c5d-bfed-c22a099349d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9625d9c-9c0d-4102-b0d4-e0dbb1c36911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Volume volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb (4ab3b8bf-3d56-41b9-9b0d-37081d4084eb): created successfully Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9625d9c-9c0d-4102-b0d4-e0dbb1c36911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Flow 'volume_create_manager' (4335aca8-b0cb-4c9a-8811-83bb091d2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2f1dca85-53e1-487f-af1b-06dfefe74efe tempest-VolumesExtendTest-103976108 None] Created volume successfully. Aug 04 12:29:15 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1075959922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6df3f2-ebcd-4856-a519-931ddf886567,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:13Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Creating volume ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:15 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1073741824 Aug 04 12:29:15 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:15 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1073741824" returned: 0 in 0.493s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:16 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 Aug 04 12:29:16 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:16 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567" returned: 0 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Attempting download of 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume ac6df3f2-ebcd-4856-a519-931ddf886567. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Creating offline snapshot 604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 of volume 4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-49f40ae6-9f1b-46e9-88c2-2906f899074a-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[75657f49-a033-457e-ac67-db6a3d52d6a1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5090ba8b-45b0-44dc-bb80-b44e85f6c792]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-49f40ae6-9f1b-46e9-88c2-2906f899074a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-quobyte-49f40ae6-9f1b-46e9-88c2-2906f899074a" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-49f40ae6-9f1b-46e9-88c2-2906f899074a" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[13939027-72a0-4dce-915d-b96f40ae63d5]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:16 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:16 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:16 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq Aug 04 12:29:16 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:16 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a Aug 04 12:29:16 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.521s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 1G Aug 04 12:29:17 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq" returned: 0 in 0.569s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a" returned: 0 in 0.479s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a Aug 04 12:29:17 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq Aug 04 12:29:17 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-49f40ae6-9f1b-46e9-88c2-2906f899074a" returned: 0 in 0.381s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-49f40ae6-9f1b-46e9-88c2-2906f899074a" released by "delete_volume" :: held 0.920s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq" returned: 1 in 0.474s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_luqwrpdq' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c129082-a430-45f2-b933-5dc04ce4d756]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 1G" returned: 0 in 0.581s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 Aug 04 12:29:17 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Created reservations ['e78c8325-9a1c-4661-9355-655b9633e653', 'ee3c041d-e220-4c84-98da-519678f70f42', '8d40be24-722e-4acd-8b9e-2cd5d9f5dd5a', 'b749a247-1fd6-45cd-942a-ef5924a2bc02'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:17 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD Aug 04 12:29:17 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:17 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:17 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:18 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-431c7801-64ad-4368-829d-1345e66c43b7 req-6bd2a13e-c604-44f1-a0b9-392fbfbd7a28 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" returned: 0 in 0.444s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 is being set with open permissions: ugo+rw Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:18 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:18 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 Aug 04 12:29:18 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:18 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 Aug 04 12:29:18 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:18 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Deleted volume successfully. Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-07c9ceba-1564-4b82-b626-48244cb76e38 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-49f40ae6-9f1b-46e9-88c2-2906f899074a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:18 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" returned: 0 in 0.264s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:18 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info Aug 04 12:29:18 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:18 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info" returned: 0 in 0.264s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info is being set with open permissions: ugo+rw Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:18 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info Aug 04 12:29:18 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:18 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.info" returned: 0 in 0.282s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-431c7801-64ad-4368-829d-1345e66c43b7 req-6bd2a13e-c604-44f1-a0b9-392fbfbd7a28 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.883s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-1287494c-9297-4fe0-bbb2-e4526c27af9a-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-431c7801-64ad-4368-829d-1345e66c43b7 req-6bd2a13e-c604-44f1-a0b9-392fbfbd7a28 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-1287494c-9297-4fe0-bbb2-e4526c27af9a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3f43835d-dda8-4243-92d8-c21d3cff06c9 tempest-VolumesExtendTest-103976108 None] Create snapshot completed successfully Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-431c7801-64ad-4368-829d-1345e66c43b7 req-6bd2a13e-c604-44f1-a0b9-392fbfbd7a28 tempest-TestInstancesWithCinderVolumes-570869958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-2f9de95c-4983-4941-b74a-a0e863e16c99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb6b23ce-b69a-412e-b8e6-8fef7fede943', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-quobyte-1287494c-9297-4fe0-bbb2-e4526c27af9a" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-1287494c-9297-4fe0-bbb2-e4526c27af9a" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5233a-79b5-4c85-9962-4a3ef758c753]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-431c7801-64ad-4368-829d-1345e66c43b7 req-6bd2a13e-c604-44f1-a0b9-392fbfbd7a28 tempest-TestInstancesWithCinderVolumes-570869958 None] attachment_update completed successfully. Aug 04 12:29:19 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a Aug 04 12:29:19 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:19 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a" returned: 0 in 0.411s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:19 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a Aug 04 12:29:19 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfaa84-5415-49aa-9df3-5d005f94ad77]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:19 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1287494c-9297-4fe0-bbb2-e4526c27af9a" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:19 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:19 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-1287494c-9297-4fe0-bbb2-e4526c27af9a" released by "delete_volume" :: held 0.888s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Created reservations ['fd860a5a-6530-4df8-98ac-4f0166782f4a', 'fc137601-8d8a-466f-afc8-18bd05f2c760', 'd0ca9ac5-db52-463d-b6ae-3379a07677a5', 'cb6ff94f-82fd-43cb-b2fb-2956cec6899d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:20 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:20 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:20 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567" returned: 0 in 2.149s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_qd3pkz8mdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:29:20 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Converted 112.00 MB image at 52.07 MB/s Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:20 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1G Aug 04 12:29:20 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:20 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.506s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 2G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 2G" returned: 0 in 0.148s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.712s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:20 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Deleted volume successfully. Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-39c51316-446f-4606-913d-f0f3c11e19a1 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-1287494c-9297-4fe0-bbb2-e4526c27af9a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a709330a-7414-4b35-a161-564007738941 tempest-VolumesExtendTest-103976108 None] Extend volume completed successfully. Aug 04 12:29:20 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 1G" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Downloaded image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume ac6df3f2-ebcd-4856-a519-931ddf886567 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 for user 695a6896fe6b4a458dcc65377b6f3947 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Marking volume ac6df3f2-ebcd-4856-a519-931ddf886567 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Copying metadata from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 to ac6df3f2-ebcd-4856-a519-931ddf886567. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Creating volume glance metadata for volume ac6df3f2-ebcd-4856-a519-931ddf886567 backed by image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabe6458-842d-4353-b0b6-812d8f0e1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6df3f2-ebcd-4856-a519-931ddf886567', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef804de-38e5-48da-9c2b-a256c4454f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:20 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Volume volume-ac6df3f2-ebcd-4856-a519-931ddf886567 (ac6df3f2-ebcd-4856-a519-931ddf886567): created successfully Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef804de-38e5-48da-9c2b-a256c4454f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (936b1a72-d6d6-42dc-b199-d9681fe53af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-81416ccf-3237-4e3d-b34f-b8c4aa507e8a tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-quobyte-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Deleting offline snapshot 604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 of volume 4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] snapshot_file for this snap is: volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdaa69-da3d-4244-b0d4-e3427f44e3d3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:21 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 Aug 04 12:29:21 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-93648ff1-7862-4ab1-a3ce-cc4b95e29f93-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-93648ff1-7862-4ab1-a3ce-cc4b95e29f93-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "cinder-quobyte-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:21 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" returned: 0 in 0.414s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" acquired by "delete_volume" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c47ad-52fd-45f1-bc1d-b4947c3e3f05]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac9620-05b3-45a2-8b97-3b4461f79cc7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:21 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:21 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:21 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 Aug 04 12:29:21 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:21 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.454s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:22 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 Aug 04 12:29:22 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:22 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" returned: 0 in 0.559s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:22 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93 Aug 04 12:29:22 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2248a9d3-b575-407e-9b3a-03011fe6697d req-17aa51e9-ced1-4c71-83c8-bba615901dae tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2248a9d3-b575-407e-9b3a-03011fe6697d req-17aa51e9-ced1-4c71-83c8-bba615901dae tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2248a9d3-b575-407e-9b3a-03011fe6697d req-17aa51e9-ced1-4c71-83c8-bba615901dae tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-2248a9d3-b575-407e-9b3a-03011fe6697d req-17aa51e9-ced1-4c71-83c8-bba615901dae tempest-TestInstancesWithCinderVolumes-570869958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-ed706b67-3f4c-403b-b3d0-4586d680654f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a28c6585-1f33-47d1-9521-44588d3714a4', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:29:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-2248a9d3-b575-407e-9b3a-03011fe6697d req-17aa51e9-ced1-4c71-83c8-bba615901dae tempest-TestInstancesWithCinderVolumes-570869958 None] attachment_update completed successfully. Aug 04 12:29:22 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-quobyte-93648ff1-7862-4ab1-a3ce-cc4b95e29f93" released by "delete_volume" :: held 0.986s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:22 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:22 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281 Aug 04 12:29:22 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Created reservations ['b977ac44-25f0-4bc1-88df-f5b87fab6b51', '24b67174-12e5-442f-bcda-d25e6f44914e', 'a5b80571-cb67-440a-a425-fe4c36342ab6', 'd33a00ea-fec4-45d1-b17a-8a96bf0336e5'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:22 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:22 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:22 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (71257bae-25f1-4bcc-9486-296d27dbe7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1790d389-136a-41d2-850b-973f576da7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb.604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" returned: 0 in 0.390s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1790d389-136a-41d2-850b-973f576da7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283970991',display_name='tempest-VolumesGetTest-Volume-688610746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066fad3-a6c0-489e-a43a-4fb3c9e29b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:23Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0641c699-89dc-4055-8d99-2c4aa5a41846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0641c699-89dc-4055-8d99-2c4aa5a41846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eefb0d-5a8e-4335-9245-361ef1f49fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84eefb0d-5a8e-4335-9245-361ef1f49fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8066fad3-a6c0-489e-a43a-4fb3c9e29b82', 'volume_name': 'volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb4bdd4-0af2-4cac-a591-38dd6db1868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb4bdd4-0af2-4cac-a591-38dd6db1868f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c7ee5e-efde-4466-a8e1-3759f0b97347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Volume 8066fad3-a6c0-489e-a43a-4fb3c9e29b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82', 'volume_size': 1} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283970991',display_name='tempest-VolumesGetTest-Volume-688610746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066fad3-a6c0-489e-a43a-4fb3c9e29b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c0aa78abb54b1497ea7fcedecdc744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:23Z,use_quota=True,user_id='695a6896fe6b4a458dcc65377b6f3947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Creating volume 8066fad3-a6c0-489e-a43a-4fb3c9e29b82 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:22 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:22 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:23 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 1073741824 Aug 04 12:29:23 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281" released by "_delete_snapshot" :: held 2.048s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Deleted volume successfully. Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" released by "delete_snapshot" :: held 2.082s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c2590edd-5d4e-410a-ba79-e5ff0b4326f9 tempest-AttachVolumeNegativeTest-22382868 None] Lock "cinder-93648ff1-7862-4ab1-a3ce-cc4b95e29f93-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Created reservations ['9d4e134c-a32e-4242-9d2c-a680b45e1329', 'c5a878c2-0b58-4398-8be6-a21189dffda3', '3db53451-b977-44b2-a329-fff15ba07754', '25c086aa-4cb9-4e78-a08b-c653af126ac7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Delete snapshot completed successfully. Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9d2e5a2c-91d6-4ece-89ae-99d673c61ca7 tempest-VolumesExtendTest-103976108 None] Lock "cinder-604b2b6d-d77e-463c-9ecf-7ceb4f9a0281-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:23 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 1073741824" returned: 0 in 0.538s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:23 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 Aug 04 12:29:23 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:23 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c7ee5e-efde-4466-a8e1-3759f0b97347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfdd1fb-0374-4d4e-8456-2e0a28b2b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Volume volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 (8066fad3-a6c0-489e-a43a-4fb3c9e29b82): created successfully Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfdd1fb-0374-4d4e-8456-2e0a28b2b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Flow 'volume_create_manager' (71257bae-25f1-4bcc-9486-296d27dbe7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7a76987e-1981-472b-96e1-acd9ec3d6a3a tempest-VolumesGetTest-148728238 None] Created volume successfully. Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "cinder-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Acquiring lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36f48d-1eb4-490b-9e92-888c09beab46]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:24 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:24 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:24 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.469s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:24 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb Aug 04 12:29:24 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-8066fad3-a6c0-489e-a43a-4fb3c9e29b82-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "cinder-8066fad3-a6c0-489e-a43a-4fb3c9e29b82-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:25 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" returned: 0 in 0.363s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94883b8-a394-4ce5-ba63-59df1f5b6193]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "cinder-quobyte-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb" released by "delete_volume" :: held 0.940s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Created reservations ['f857008d-60c7-4662-96ad-35ce32fade1d', '09948a96-f4fb-405c-b8f0-34b3b7022ba7', '316238a2-bb26-4db0-b92f-f31ac7e128ea', 'efeb95ab-2041-43b3-ba5f-b31732f502ee'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:25 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 Aug 04 12:29:25 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:25 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:25 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:25 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" returned: 0 in 0.514s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:25 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.286s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Deleted volume successfully. Aug 04 12:29:25 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82 Aug 04 12:29:25 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-77cf921e-915d-4886-8514-5b4767a23aa0 tempest-VolumesExtendTest-103976108 None] Lock "cinder-4ab3b8bf-3d56-41b9-9b0d-37081d4084eb-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:26 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-8066fad3-a6c0-489e-a43a-4fb3c9e29b82" released by "delete_volume" :: held 0.876s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Created reservations ['e3c4331f-227c-41ce-8649-6063514097b8', '8ad05ae6-f095-427c-8cb7-7f883ea58003', 'e62d8a56-2946-4fd2-a20a-06b6d600fce1', 'c9fef26e-c7bf-4733-94cd-7b0511e5c797'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:26 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:26 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-ac6df3f2-ebcd-4856-a519-931ddf886567-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "cinder-ac6df3f2-ebcd-4856-a519-931ddf886567-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Acquiring lock "cinder-quobyte-ac6df3f2-ebcd-4856-a519-931ddf886567" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-ac6df3f2-ebcd-4856-a519-931ddf886567" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c240ff-8069-45ab-8e50-cc8860a491ef]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:26 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.423s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:29:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-10e87df5-3281-4271-bc17-70a92332c14f tempest-VolumesGetTest-148728238 None] Lock "cinder-8066fad3-a6c0-489e-a43a-4fb3c9e29b82-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:26 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 Aug 04 12:29:26 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:27 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:27 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567 Aug 04 12:29:27 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:27 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6df3f2-ebcd-4856-a519-931ddf886567" returned: 0 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "cinder-quobyte-ac6df3f2-ebcd-4856-a519-931ddf886567" released by "delete_volume" :: held 0.981s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:29 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Created reservations ['3d364470-2d52-4859-aae5-db0354dc1f01', 'e16a7634-b579-4102-8762-dd5c008ee5db', '921b7222-83f1-4c9c-9c18-6487d43c2ea9', 'eaf41715-8d62-4114-8545-c5dd40702dd1'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:32 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:32 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:33 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.402s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Deleted volume successfully. Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-52d82dc0-18fe-4a15-bc7c-3c6a576f5b5e tempest-VolumesGetTest-148728238 None] Lock "cinder-ac6df3f2-ebcd-4856-a519-931ddf886567-delete_volume" released by "delete_volume" :: held 6.725s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-513ede9f-44da-4162-a8fd-8ddb090c73d4 req-ae050c16-781e-4e79-b3c0-29a1b791bbd6 tempest-TestInstancesWithCinderVolumes-570869958 None] Terminate volume connection completed successfully. Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-513ede9f-44da-4162-a8fd-8ddb090c73d4 req-ae050c16-781e-4e79-b3c0-29a1b791bbd6 tempest-TestInstancesWithCinderVolumes-570869958 None] Deleting attachment fb6b23ce-b69a-412e-b8e6-8fef7fede943. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-2f9de95c-4983-4941-b74a-a0e863e16c99-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-2f9de95c-4983-4941-b74a-a0e863e16c99-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-quobyte-2f9de95c-4983-4941-b74a-a0e863e16c99" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-2f9de95c-4983-4941-b74a-a0e863e16c99" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007dca7-77a3-479b-9f68-4d45863a1925]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:34 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 Aug 04 12:29:34 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:34 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99" returned: 0 in 0.426s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:34 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99 Aug 04 12:29:34 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:34 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2f9de95c-4983-4941-b74a-a0e863e16c99" returned: 0 in 0.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-2f9de95c-4983-4941-b74a-a0e863e16c99" released by "delete_volume" :: held 0.823s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:34 devstack cinder-volume[88895]: WARNING cinder.quota [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2143011925-1066371859 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2143011925-1066371859, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:34 devstack cinder-volume[88895]: WARNING cinder.quota [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2143011925-1066371859 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2143011925-1066371859, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Created reservations ['b349bee8-054a-4297-9e38-346e6eff1b66', '26a90112-38bd-4110-8527-f507ef4ee7ab', '532d1e59-1ee3-462e-8238-5208dc39b792', '28d24bf7-20b5-474e-8183-6d2aae13cea9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:35 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:35 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:35 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Deleted volume successfully. Aug 04 12:29:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f2dab954-d5f1-409b-a620-2fbaefa2d9b1 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-2f9de95c-4983-4941-b74a-a0e863e16c99-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Flow 'volume_create_manager' (f25c2a5e-4ef7-4f04-81ef-db938f8dac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83b19de-0015-4185-b368-6118f9a534b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83b19de-0015-4185-b368-6118f9a534b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1539932713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860e4a1e-265b-42df-aa34-58bd09d20325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de0b77deaa6405680b67309055ef8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:36Z,use_quota=True,user_id='a31c6148116f4a4f8c64733e1a6bce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cc0a29-5a10-4e5c-a6be-959242e86efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cc0a29-5a10-4e5c-a6be-959242e86efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9f1992-3ad0-4403-9203-87cf831d4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9f1992-3ad0-4403-9203-87cf831d4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860e4a1e-265b-42df-aa34-58bd09d20325', 'volume_name': 'volume-860e4a1e-265b-42df-aa34-58bd09d20325', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0c4d2-43fb-48af-90f3-491d5e2ff293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0c4d2-43fb-48af-90f3-491d5e2ff293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599b6476-557d-4068-8eb3-76985b22e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:36 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Volume 860e4a1e-265b-42df-aa34-58bd09d20325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860e4a1e-265b-42df-aa34-58bd09d20325', 'volume_size': 1} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1539932713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860e4a1e-265b-42df-aa34-58bd09d20325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de0b77deaa6405680b67309055ef8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:29:36Z,use_quota=True,user_id='a31c6148116f4a4f8c64733e1a6bce95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Creating volume 860e4a1e-265b-42df-aa34-58bd09d20325 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:29:36 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:29:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:36 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 1073741824 Aug 04 12:29:36 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:37 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 1073741824" returned: 0 in 0.631s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:37 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 Aug 04 12:29:37 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abf5df0e-c5d0-4f2c-b13a-093013065913 tempest-BackendsCapabilitiesAdminTestsJSON-869025296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88895) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-f716fbe0-5f71-496b-a05a-9e15acf36499 tempest-BackendsCapabilitiesAdminTestsJSON-869025296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88895) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 04 12:29:37 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325" returned: 0 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599b6476-557d-4068-8eb3-76985b22e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860e4a1e-265b-42df-aa34-58bd09d20325', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa0ce1b-4eab-48ca-aea3-d1d1b361bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:29:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Volume volume-860e4a1e-265b-42df-aa34-58bd09d20325 (860e4a1e-265b-42df-aa34-58bd09d20325): created successfully Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa0ce1b-4eab-48ca-aea3-d1d1b361bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:29:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Flow 'volume_create_manager' (f25c2a5e-4ef7-4f04-81ef-db938f8dac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:29:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fdb61488-d4be-4831-af8b-d67514478463 tempest-VolumesNegativeTest-1822772323 None] Created volume successfully. Aug 04 12:29:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-3f822637-2bd7-4de1-9dc8-155477acff44 req-fa20285e-ac6a-4e6e-8c8d-ffdbc9678ffc tempest-TestInstancesWithCinderVolumes-570869958 None] Terminate volume connection completed successfully. Aug 04 12:29:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-3f822637-2bd7-4de1-9dc8-155477acff44 req-fa20285e-ac6a-4e6e-8c8d-ffdbc9678ffc tempest-TestInstancesWithCinderVolumes-570869958 None] Deleting attachment a28c6585-1f33-47d1-9521-44588d3714a4. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-ed706b67-3f4c-403b-b3d0-4586d680654f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-ed706b67-3f4c-403b-b3d0-4586d680654f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-quobyte-ed706b67-3f4c-403b-b3d0-4586d680654f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-ed706b67-3f4c-403b-b3d0-4586d680654f" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b308fac-8584-4266-8ad8-904818d83307]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:39 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f Aug 04 12:29:39 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:39 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f" returned: 0 in 0.474s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:39 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f Aug 04 12:29:39 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:40 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ed706b67-3f4c-403b-b3d0-4586d680654f" returned: 0 in 0.388s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-ed706b67-3f4c-403b-b3d0-4586d680654f" released by "delete_volume" :: held 0.934s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:40 devstack cinder-volume[88895]: WARNING cinder.quota [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162292208-1217521712 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162292208-1217521712, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:40 devstack cinder-volume[88895]: WARNING cinder.quota [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162292208-1217521712 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-162292208-1217521712, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Created reservations ['51bbf2e5-4e9e-4f45-a4bf-532c4de98c8d', '12c50401-9b67-4743-bcf9-57b5db7945e2', 'caed16c8-c3b0-40cc-a5db-ae2b63ffef88', 'c43bc816-c49c-476b-86b7-57c0583a6738'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:40 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:40 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:40 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.353s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Deleted volume successfully. Aug 04 12:29:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ed1552c5-c8dc-4266-b285-2647c9eb36e2 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-ed706b67-3f4c-403b-b3d0-4586d680654f-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-72ef3882-f731-46c0-b54c-a607532d7277 req-c73d24c8-73aa-436e-be2f-7f10943f1502 tempest-TestInstancesWithCinderVolumes-570869958 None] Terminate volume connection completed successfully. Aug 04 12:29:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-72ef3882-f731-46c0-b54c-a607532d7277 req-c73d24c8-73aa-436e-be2f-7f10943f1502 tempest-TestInstancesWithCinderVolumes-570869958 None] Deleting attachment 0ee03bf6-ec82-4be1-b0de-b72a4b6d737e. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-68175dc0-6654-4b4e-8716-da3a55fb36d2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-68175dc0-6654-4b4e-8716-da3a55fb36d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "cinder-quobyte-68175dc0-6654-4b4e-8716-da3a55fb36d2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-68175dc0-6654-4b4e-8716-da3a55fb36d2" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4deff6-fdb5-49fe-b76c-f2feae26f580]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:48 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 Aug 04 12:29:48 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:48 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2" returned: 0 in 0.433s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:48 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2 Aug 04 12:29:48 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:48 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-68175dc0-6654-4b4e-8716-da3a55fb36d2" returned: 0 in 0.296s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-quobyte-68175dc0-6654-4b4e-8716-da3a55fb36d2" released by "delete_volume" :: held 0.826s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:49 devstack cinder-volume[88895]: WARNING cinder.quota [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2129685496-167353336 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2129685496-167353336, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:49 devstack cinder-volume[88895]: WARNING cinder.quota [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2129685496-167353336 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2129685496-167353336, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Created reservations ['51910eef-530d-4887-ad70-a8bebabe9081', '50ca3940-98c9-4f5d-bdfe-822d2cea2bc6', '98ce43d3-415b-4f2a-a775-9add6a2a0ba9', '1729abaa-88b0-41c8-8de0-fc906cc6bffc'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:49 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:49 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:49 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Deleted volume successfully. Aug 04 12:29:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-701c39aa-10ee-42f0-a724-744f27426063 tempest-TestInstancesWithCinderVolumes-570869958 None] Lock "cinder-68175dc0-6654-4b4e-8716-da3a55fb36d2-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:29:53 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=143,cinder:SELECT=133,cinder:INSERT=40,cinder:DELETE=13 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:29:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b3e43a4-ad86-43bf-a3c6-cc236195b2fc tempest-GroupsV320Test-1365686119 None] Group tempest-GroupsV320Test-Group-454213637: creating Aug 04 12:29:53 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=130,cinder:INSERT=52,cinder:UPDATE=154,cinder:DELETE=9 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:29:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b3e43a4-ad86-43bf-a3c6-cc236195b2fc tempest-GroupsV320Test-1365686119 None] Group tempest-GroupsV320Test-Group-454213637: created successfully Aug 04 12:29:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2b3e43a4-ad86-43bf-a3c6-cc236195b2fc tempest-GroupsV320Test-1365686119 None] Create group completed successfully. Aug 04 12:29:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Created reservations ['d786cfcc-cfa2-46d6-818b-ce01161bcc99'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:29:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:29:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:29:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:29:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:29:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:29:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:29:56 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:29:56 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:29:56 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Aug 04 12:29:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:29:56 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:29:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9cbbcebd-d5e7-4fe2-b430-99e504a0057b tempest-GroupsV320Test-1365686119 None] Delete group completed successfully. Aug 04 12:30:05 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:30:05 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:06 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:30:06 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:06 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.417s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:30:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Acquiring lock "cinder-860e4a1e-265b-42df-aa34-58bd09d20325-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "cinder-860e4a1e-265b-42df-aa34-58bd09d20325-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Acquiring lock "cinder-quobyte-860e4a1e-265b-42df-aa34-58bd09d20325" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "cinder-quobyte-860e4a1e-265b-42df-aa34-58bd09d20325" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a98e34-efa3-475b-b6bd-f89c97391936]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:14 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 Aug 04 12:30:14 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:14 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325" returned: 0 in 0.459s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:14 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325 Aug 04 12:30:14 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:15 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-860e4a1e-265b-42df-aa34-58bd09d20325" returned: 0 in 0.317s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "cinder-quobyte-860e4a1e-265b-42df-aa34-58bd09d20325" released by "delete_volume" :: held 0.836s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Created reservations ['5196c4b1-163f-44ea-b95b-3e02d6e0cd79', '3a4ba2ff-0343-4f72-9a39-979acadd9b37', '81edccee-5738-4f57-a310-ac44d54b1621', '74d2d0fc-f05d-4037-9e65-d74efa005928'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:15 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:30:15 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:15 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.423s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:30:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Deleted volume successfully. Aug 04 12:30:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0d68f04b-12e6-4840-acd0-d5c3eda53274 tempest-VolumesNegativeTest-1822772323 None] Lock "cinder-860e4a1e-265b-42df-aa34-58bd09d20325-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Flow 'volume_create_manager' (b3fe319f-ed07-4aca-9a47-fd41a40caca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da5b2b6-b0d2-4a66-9821-d7814d44d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da5b2b6-b0d2-4a66-9821-d7814d44d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-678171509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec03e830-e7c4-437e-84f8-890a8672076f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359efd4db04348d8815cacac7b928c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:17Z,use_quota=True,user_id='e4722b47f368423e9e859647d57b8ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f432034-107c-4010-9ef1-5b373693460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f432034-107c-4010-9ef1-5b373693460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9c1a22-bfbf-4bf0-bafb-5c24f7a23ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9c1a22-bfbf-4bf0-bafb-5c24f7a23ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec03e830-e7c4-437e-84f8-890a8672076f', 'volume_name': 'volume-ec03e830-e7c4-437e-84f8-890a8672076f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2764cb24-a099-4d77-ad6b-e9622f8b93c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2764cb24-a099-4d77-ad6b-e9622f8b93c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66c4a93-ca90-4568-a1de-9d60979d1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Volume ec03e830-e7c4-437e-84f8-890a8672076f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec03e830-e7c4-437e-84f8-890a8672076f', 'volume_size': 1} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-678171509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec03e830-e7c4-437e-84f8-890a8672076f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359efd4db04348d8815cacac7b928c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:17Z,use_quota=True,user_id='e4722b47f368423e9e859647d57b8ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Creating volume ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:30:16 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:30:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:17 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f 1073741824 Aug 04 12:30:17 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:17 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f 1073741824" returned: 0 in 0.620s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:17 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:17 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:17 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.315s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66c4a93-ca90-4568-a1de-9d60979d1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec03e830-e7c4-437e-84f8-890a8672076f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baccc1c-300d-43ed-89e4-012e69cd0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:18 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Volume volume-ec03e830-e7c4-437e-84f8-890a8672076f (ec03e830-e7c4-437e-84f8-890a8672076f): created successfully Aug 04 12:30:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baccc1c-300d-43ed-89e4-012e69cd0565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Flow 'volume_create_manager' (b3fe319f-ed07-4aca-9a47-fd41a40caca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5b46b676-3fa8-48c0-a50b-2f109a5a99d2 tempest-TestImageHashVerification-1151744775 None] Created volume successfully. Aug 04 12:30:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70c819-9c97-4383-9f1f-e48f996314f4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:20 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:20 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:21 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.551s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa9fe4-70ca-42e3-8a6a-165f5a11c4cf]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Flow 'volume_create_manager' (4fd549a5-8e53-4e5e-a3a6-d88cad0e605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd1a4ae-29a7-4196-9202-20e2f520cdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd1a4ae-29a7-4196-9202-20e2f520cdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1715261940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a90a53-619c-49da-8842-550d8ceb2416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794049a8693842e180e660fb8fecc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:21Z,use_quota=True,user_id='df9c2466316643588b6ece28ce0629d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a8bf3c-e827-49aa-8d5a-05d914937a0a),volume_type_id=f9a8bf3c-e827-49aa-8d5a-05d914937a0a)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:21 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5244abea-389a-48bc-834e-7d3220ad1876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5244abea-389a-48bc-834e-7d3220ad1876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f91410c-f869-4f85-a8c3-aeda9fe7c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f91410c-f869-4f85-a8c3-aeda9fe7c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a90a53-619c-49da-8842-550d8ceb2416', 'volume_name': 'volume-64a90a53-619c-49da-8842-550d8ceb2416', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a35ce36-f8ba-4732-a138-7f7b591038fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a35ce36-f8ba-4732-a138-7f7b591038fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb84755-281e-4cea-a7ce-2a5b0b7b5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Volume 64a90a53-619c-49da-8842-550d8ceb2416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a90a53-619c-49da-8842-550d8ceb2416', 'volume_size': 1} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Flow 'volume_create_manager' (69036740-6220-4a19-9e7a-a41896ef7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a49f213-9c46-4f5e-b475-751e03bcfb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a49f213-9c46-4f5e-b475-751e03bcfb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-731578477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac73f6-84e8-4287-9a37-0741c57bf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdaec2941b34317a4d8d491c11eca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:21Z,use_quota=True,user_id='c51b2667194945bc9543598e99212f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221c4b32-fff2-4d97-b63d-99cba867c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221c4b32-fff2-4d97-b63d-99cba867c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b69ec-a821-4f03-b802-fa4aec73ce65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b69ec-a821-4f03-b802-fa4aec73ce65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ac73f6-84e8-4287-9a37-0741c57bf687', 'volume_name': 'volume-e8ac73f6-84e8-4287-9a37-0741c57bf687', 'volume_size': 2}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f00fbd-874a-4548-83d7-dafaf6c60919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f00fbd-874a-4548-83d7-dafaf6c60919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fb577d-3118-4679-8908-4dd1134b9df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Volume e8ac73f6-84e8-4287-9a37-0741c57bf687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ac73f6-84e8-4287-9a37-0741c57bf687', 'volume_size': 2} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:21 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f /opt/stack/data/cinder/conversion/ec03e830-e7c4-437e-84f8-890a8672076f.temp_image.1f930dfa-58e3-4fa7-a028-cc06157210254n3bu_33.img {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:21 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f /opt/stack/data/cinder/conversion/ec03e830-e7c4-437e-84f8-890a8672076f.temp_image.1f930dfa-58e3-4fa7-a028-cc06157210254n3bu_33.img Aug 04 12:30:21 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:26 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f /opt/stack/data/cinder/conversion/ec03e830-e7c4-437e-84f8-890a8672076f.temp_image.1f930dfa-58e3-4fa7-a028-cc06157210254n3bu_33.img" returned: 0 in 5.015s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba488664-ffd3-4614-9a82-07913b4bc23f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:26 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:26 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:27 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.579s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:27 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/conversion/ec03e830-e7c4-437e-84f8-890a8672076f.temp_image.1f930dfa-58e3-4fa7-a028-cc06157210254n3bu_33.img {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:30:27 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Converted 1024.00 MB image at 204.13 MB/s Aug 04 12:30:27 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] 1f930dfa-58e3-4fa7-a028-cc0615721025 was raw, no need to convert to raw {{(pid=88895) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 04 12:30:31 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:30:37 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.789s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Uploaded volume to glance image-id: 1f930dfa-58e3-4fa7-a028-cc0615721025. {{(pid=88895) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.960s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1715261940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a90a53-619c-49da-8842-550d8ceb2416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794049a8693842e180e660fb8fecc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:21Z,use_quota=True,user_id='df9c2466316643588b6ece28ce0629d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a8bf3c-e827-49aa-8d5a-05d914937a0a),volume_type_id=f9a8bf3c-e827-49aa-8d5a-05d914937a0a)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Creating volume 64a90a53-619c-49da-8842-550d8ceb2416 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:30:49 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-87e167b8-6bf6-48ce-94cf-e9dc2f4b3a0d tempest-TestImageHashVerification-1151744775 None] Copy volume to image completed successfully. Aug 04 12:30:49 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 1073741824 Aug 04 12:30:49 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:49 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 1073741824" returned: 0 in 0.595s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:49 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 Aug 04 12:30:49 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:50 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416" returned: 0 in 0.384s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.881s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-731578477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac73f6-84e8-4287-9a37-0741c57bf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdaec2941b34317a4d8d491c11eca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:21Z,use_quota=True,user_id='c51b2667194945bc9543598e99212f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Creating volume e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:30:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 2147483648 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb84755-281e-4cea-a7ce-2a5b0b7b5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a90a53-619c-49da-8842-550d8ceb2416', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 2147483648 Aug 04 12:30:50 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42103157-3eed-48f5-8a2e-99a044b9ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Volume volume-64a90a53-619c-49da-8842-550d8ceb2416 (64a90a53-619c-49da-8842-550d8ceb2416): created successfully Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42103157-3eed-48f5-8a2e-99a044b9ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Flow 'volume_create_manager' (4fd549a5-8e53-4e5e-a3a6-d88cad0e605d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fbd4cb6f-7d1b-4ade-b426-263d1e3365d1 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Created volume successfully. Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Flow 'volume_create_manager' (04dbdc0e-6718-4d7f-b3c1-9e1460c00c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42fc5ee3-32c5-47d9-b30d-5eacbc7c1f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Acquiring lock "cinder-ec03e830-e7c4-437e-84f8-890a8672076f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42fc5ee3-32c5-47d9-b30d-5eacbc7c1f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-915671642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44c8f1b-499f-4dff-a840-8d099e53f35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0770945a809a414ba608cc6d56b8e6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:51Z,use_quota=True,user_id='7a8ae14e19fa4fe4b03bf607d9c53f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1129b5-e6a6-406c-b7f3-77a0c48c8d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1129b5-e6a6-406c-b7f3-77a0c48c8d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ab719c-60b0-4cec-9b14-0dfe7447e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ab719c-60b0-4cec-9b14-0dfe7447e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44c8f1b-499f-4dff-a840-8d099e53f35d', 'volume_name': 'volume-a44c8f1b-499f-4dff-a840-8d099e53f35d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c330e-10d1-4ade-8a29-5abfd2d22629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c330e-10d1-4ade-8a29-5abfd2d22629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376597f3-6233-4fd3-8b62-d6ee5a4f0b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Volume a44c8f1b-499f-4dff-a840-8d099e53f35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44c8f1b-499f-4dff-a840-8d099e53f35d', 'volume_size': 1} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "cinder-ec03e830-e7c4-437e-84f8-890a8672076f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Acquiring lock "cinder-quobyte-ec03e830-e7c4-437e-84f8-890a8672076f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "cinder-quobyte-ec03e830-e7c4-437e-84f8-890a8672076f" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea0ee74-219d-42b9-bbea-2e918f01fd57]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:51 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:51 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:51 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 2147483648" returned: 0 in 0.979s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:51 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:30:51 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:51 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 Aug 04 12:30:51 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:51 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.563s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:51 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f Aug 04 12:30:51 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:51 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:30:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-58733800-1297-48b9-9c09-fbe7df837cd0 tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Retype volume completed successfully. Aug 04 12:30:51 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687" returned: 0 in 0.318s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-915671642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44c8f1b-499f-4dff-a840-8d099e53f35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0770945a809a414ba608cc6d56b8e6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:30:51Z,use_quota=True,user_id='7a8ae14e19fa4fe4b03bf607d9c53f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Creating volume a44c8f1b-499f-4dff-a840-8d099e53f35d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:30:51 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fb577d-3118-4679-8908-4dd1134b9df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ac73f6-84e8-4287-9a37-0741c57bf687', 'volume_size': 2}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d858de1-ec43-490c-81a2-7224f81b8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:51 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d 1073741824 Aug 04 12:30:51 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Volume volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 (e8ac73f6-84e8-4287-9a37-0741c57bf687): created successfully Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d858de1-ec43-490c-81a2-7224f81b8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Flow 'volume_create_manager' (69036740-6220-4a19-9e7a-a41896ef7688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-61bb41d3-01aa-4cb7-b4ab-6fe3499a953e tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Created volume successfully. Aug 04 12:30:51 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ec03e830-e7c4-437e-84f8-890a8672076f" returned: 0 in 0.291s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "cinder-quobyte-ec03e830-e7c4-437e-84f8-890a8672076f" released by "delete_volume" :: held 0.916s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Created reservations ['3acbc5be-388c-4c8e-a6c6-7b0f577202c0', '9a2fdf5c-c65c-41d0-84c5-812a0a5ebfa1', '32bc994d-03e1-4751-be3a-90b09d39fe76', 'ae5de599-a556-415e-804f-0be1c6a2718e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:52 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:30:52 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:52 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d 1073741824" returned: 0 in 0.759s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:52 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.548s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:30:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Deleted volume successfully. Aug 04 12:30:52 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d Aug 04 12:30:52 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c06b99a9-f779-4f60-8f08-8ece43df5989 tempest-TestImageHashVerification-1151744775 None] Lock "cinder-ec03e830-e7c4-437e-84f8-890a8672076f-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "cinder-64a90a53-619c-49da-8842-550d8ceb2416-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "cinder-64a90a53-619c-49da-8842-550d8ceb2416-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:52 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d" returned: 0 in 0.321s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "cinder-quobyte-64a90a53-619c-49da-8842-550d8ceb2416" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376597f3-6233-4fd3-8b62-d6ee5a4f0b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44c8f1b-499f-4dff-a840-8d099e53f35d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253f288a-446f-4200-889a-7dca5f4ed1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Creating offline snapshot c741fa72-02bf-4b49-bed4-b1bd2811cbc8 of volume e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "cinder-quobyte-64a90a53-619c-49da-8842-550d8ceb2416" acquired by "delete_volume" :: waited 0.046s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[628b8b2a-fb41-4511-b6d6-81f069868861]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Volume volume-a44c8f1b-499f-4dff-a840-8d099e53f35d (a44c8f1b-499f-4dff-a840-8d099e53f35d): created successfully Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253f288a-446f-4200-889a-7dca5f4ed1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Flow 'volume_create_manager' (04dbdc0e-6718-4d7f-b3c1-9e1460c00c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfc0a5-78c5-4879-9339-017905965cce]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6899aaed-8146-47b9-80b3-c4e101b137fa tempest-TestMinimumBasicScenario-1840342048 None] Created volume successfully. Aug 04 12:30:53 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 Aug 04 12:30:53 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:53 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 Aug 04 12:30:53 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:53 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687" returned: 0 in 0.562s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 2G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:53 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416" returned: 0 in 0.543s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:53 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 2G Aug 04 12:30:53 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:53 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416 Aug 04 12:30:53 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:53 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-64a90a53-619c-49da-8842-550d8ceb2416" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "cinder-quobyte-64a90a53-619c-49da-8842-550d8ceb2416" released by "delete_volume" :: held 0.925s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:53 devstack cinder-volume[88895]: WARNING cinder.quota [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:30:53 devstack cinder-volume[88895]: WARNING cinder.quota [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Created reservations ['c33b507c-598d-4543-ba46-5ba9e4d06266', 'c533ebd9-8ef3-435c-a425-9727c7d0b38a', 'c2b727df-b23f-41ca-91e7-a542f763bf80', '40aac327-1218-46fd-bee3-accb373ccf33'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:30:53 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 2G" returned: 0 in 0.495s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:54 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 Aug 04 12:30:54 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:54 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:30:54 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:54 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8" returned: 0 in 0.585s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:54 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 is being set with open permissions: ugo+rw Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:54 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 Aug 04 12:30:54 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:54 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.531s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:30:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Deleted volume successfully. Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3c3e04c4-acf1-453c-906d-3976140eff6d tempest-VolumeRetypeWithoutMigrationTest-834074246 None] Lock "cinder-64a90a53-619c-49da-8842-550d8ceb2416-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:54 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8" returned: 0 in 0.377s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:55 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info Aug 04 12:30:55 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:55 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info" returned: 0 in 0.558s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:55 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info is being set with open permissions: ugo+rw Aug 04 12:30:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:55 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info Aug 04 12:30:55 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-4b055c76-3114-40df-9ea4-6e3638f2731f req-7681bb2a-f421-49b9-8a2b-47b9a11752f0 tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:30:55 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.info" returned: 0 in 0.359s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-4b055c76-3114-40df-9ea4-6e3638f2731f req-7681bb2a-f421-49b9-8a2b-47b9a11752f0 tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.064s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-4b055c76-3114-40df-9ea4-6e3638f2731f req-7681bb2a-f421-49b9-8a2b-47b9a11752f0 tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:30:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fe3de96f-d85d-4bed-806c-8e7f99d049f3 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Create snapshot completed successfully Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-4b055c76-3114-40df-9ea4-6e3638f2731f req-7681bb2a-f421-49b9-8a2b-47b9a11752f0 tempest-TestMinimumBasicScenario-1840342048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-a44c8f1b-499f-4dff-a840-8d099e53f35d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd02dd93b-001c-4c0f-bb0f-c9abbcd7ba34', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:30:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-4b055c76-3114-40df-9ea4-6e3638f2731f req-7681bb2a-f421-49b9-8a2b-47b9a11752f0 tempest-TestMinimumBasicScenario-1840342048 None] attachment_update completed successfully. Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "cinder-c741fa72-02bf-4b49-bed4-b1bd2811cbc8-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-c741fa72-02bf-4b49-bed4-b1bd2811cbc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "cinder-quobyte-c741fa72-02bf-4b49-bed4-b1bd2811cbc8" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-c741fa72-02bf-4b49-bed4-b1bd2811cbc8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:30:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Deleting offline snapshot c741fa72-02bf-4b49-bed4-b1bd2811cbc8 of volume e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] snapshot_file for this snap is: volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f1398-9470-4475-adeb-5715f7db705f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:57 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 Aug 04 12:30:57 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:57 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8" returned: 0 in 0.571s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ac73f6-84e8-4287-9a37-0741c57bf687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99b566-0506-4953-a307-9c1e0d6b7498]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:30:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:57 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 Aug 04 12:30:57 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:58 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687" returned: 0 in 0.672s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:58 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 Aug 04 12:30:58 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:58 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8" returned: 0 in 0.617s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:30:59 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8 Aug 04 12:30:59 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:30:59 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Aug 04 12:30:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687.c741fa72-02bf-4b49-bed4-b1bd2811cbc8" returned: 0 in 0.457s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:30:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-c741fa72-02bf-4b49-bed4-b1bd2811cbc8" released by "_delete_snapshot" :: held 2.505s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" released by "delete_snapshot" :: held 2.554s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:30:59 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Created reservations ['b0702716-1b50-4d4b-9833-612a1fb7067c', '7a5c5d07-44e4-4b62-911e-625f9f83622c', '1da81ec8-bade-47a7-aa04-31e431e696d0', '9f258a6d-ad55-45c6-b9c9-fc91ad766aaf'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:30:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Delete snapshot completed successfully. Aug 04 12:30:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-85e95668-d86e-4daf-bef6-3feecbb6df0a tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-c741fa72-02bf-4b49-bed4-b1bd2811cbc8-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "cinder-e8ac73f6-84e8-4287-9a37-0741c57bf687-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-e8ac73f6-84e8-4287-9a37-0741c57bf687-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" acquired by "delete_volume" :: waited 0.061s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[636e9f8a-66d2-424c-b753-ecf5602b20eb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:00 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 Aug 04 12:31:00 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:01 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687" returned: 0 in 0.597s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:01 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687 Aug 04 12:31:01 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:01 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8ac73f6-84e8-4287-9a37-0741c57bf687" returned: 0 in 0.295s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-quobyte-e8ac73f6-84e8-4287-9a37-0741c57bf687" released by "delete_volume" :: held 1.048s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Created reservations ['18e0dcaa-1ae2-47d0-8677-8814a98d609a', '10b1efdc-1c71-437e-8bb4-47de8b322807', 'ebdb2a7e-0343-427a-a4aa-2e77ecff0df5', 'e6da680f-cd3f-4cc0-95ca-781ceab8a1a9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:01 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:31:01 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:02 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.339s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:02 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:31:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Deleted volume successfully. Aug 04 12:31:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-be8719fd-1d83-4828-8cd2-613e878cdd41 tempest-VolumesSnapshotNegativeTestJSON-2086771358 None] Lock "cinder-e8ac73f6-84e8-4287-9a37-0741c57bf687-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Flow 'volume_create_manager' (cf3aa9e4-9448-4a93-a999-172735d359ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d12bf-20ae-4a8e-b444-b2becf52c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d12bf-20ae-4a8e-b444-b2becf52c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1427432788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764d9b4-b126-4b02-b440-999834dce747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5885ab83764a45afac965e176caa57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:05Z,use_quota=True,user_id='230843784da94480b99e28945b1a506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d76564-b068-4909-9f40-242ccfb9fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d76564-b068-4909-9f40-242ccfb9fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfdb44c-bd4f-47c4-a427-2b2085355aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfdb44c-bd4f-47c4-a427-2b2085355aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6764d9b4-b126-4b02-b440-999834dce747', 'volume_name': 'volume-6764d9b4-b126-4b02-b440-999834dce747', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1715c45-a43b-4ce7-b0e9-e32cb43e0c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1715c45-a43b-4ce7-b0e9-e32cb43e0c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43de275a-8027-4e0a-8248-88cfd3dfdcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Volume 6764d9b4-b126-4b02-b440-999834dce747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6764d9b4-b126-4b02-b440-999834dce747', 'volume_size': 1} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1427432788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764d9b4-b126-4b02-b440-999834dce747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5885ab83764a45afac965e176caa57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:05Z,use_quota=True,user_id='230843784da94480b99e28945b1a506e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Creating volume 6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:31:05 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:31:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:05 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 1073741824 Aug 04 12:31:05 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:06 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 1073741824" returned: 0 in 0.633s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:06 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:31:06 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:06 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 Aug 04 12:31:06 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:06 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.319s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:31:06 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747" returned: 0 in 0.380s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43de275a-8027-4e0a-8248-88cfd3dfdcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6764d9b4-b126-4b02-b440-999834dce747', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83318744-ead9-4aa3-b996-1436703a94a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:06 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Volume volume-6764d9b4-b126-4b02-b440-999834dce747 (6764d9b4-b126-4b02-b440-999834dce747): created successfully Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83318744-ead9-4aa3-b996-1436703a94a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Flow 'volume_create_manager' (cf3aa9e4-9448-4a93-a999-172735d359ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-62a8f986-8a0a-442b-a690-4433fe87586a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Created volume successfully. Aug 04 12:31:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Creating offline snapshot f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 of volume 6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:31:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[af00f188-ad4c-4c7a-9549-c9f8f20753e2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:08 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 Aug 04 12:31:08 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:08 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747" returned: 0 in 0.486s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:08 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 1G Aug 04 12:31:08 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:09 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 1G" returned: 0 in 0.589s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764d9b4-b126-4b02-b440-999834dce747 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:09 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764d9b4-b126-4b02-b440-999834dce747 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 Aug 04 12:31:09 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:09 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6764d9b4-b126-4b02-b440-999834dce747 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:09 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 is being set with open permissions: ugo+rw Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:09 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 Aug 04 12:31:09 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:09 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" returned: 0 in 0.400s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:09 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info Aug 04 12:31:09 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:10 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info" returned: 0 in 0.389s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:10 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info is being set with open permissions: ugo+rw Aug 04 12:31:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:10 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info Aug 04 12:31:10 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:10 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.info" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-32b51caf-911b-4ab0-a2ab-66bee8376144 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Create snapshot completed successfully Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "cinder-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "cinder-quobyte-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Deleting offline snapshot f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 of volume 6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] snapshot_file for this snap is: volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8a54f5-85fa-41c9-ad7e-be3ff790ce4e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:12 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 Aug 04 12:31:12 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:12 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" returned: 0 in 0.540s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6764d9b4-b126-4b02-b440-999834dce747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8e52b-232b-44d6-a774-ec6f892e3742]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:12 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 Aug 04 12:31:12 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:12 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:12 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 Aug 04 12:31:12 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:13 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" returned: 0 in 0.382s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:13 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7 Aug 04 12:31:13 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:13 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747.f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" returned: 0 in 0.298s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7" released by "_delete_snapshot" :: held 1.825s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" released by "delete_snapshot" :: held 1.875s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Created reservations ['e0db7d35-9361-4aa8-aafa-09e15e80d9a0', '474eca6e-256a-46d4-bf35-3bc167a0fa83', 'c5d78c16-73b8-421b-bb5f-d7320cc3512b', '5891ed58-c159-4024-b2e2-c3d75c73c04d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:31:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Delete snapshot completed successfully. Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65815791-83d5-4294-8a45-1afa21f4880a tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-f076ed9b-99d0-4fc8-a3e6-0ebe672ca6a7-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "cinder-6764d9b4-b126-4b02-b440-999834dce747-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-6764d9b4-b126-4b02-b440-999834dce747-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[08460b2e-2b67-4248-9b21-c2e5cfec2efd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:14 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 Aug 04 12:31:14 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:14 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747" returned: 0 in 0.447s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:14 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747 Aug 04 12:31:14 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:14 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6764d9b4-b126-4b02-b440-999834dce747" returned: 0 in 0.288s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-quobyte-6764d9b4-b126-4b02-b440-999834dce747" released by "delete_volume" :: held 0.827s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Created reservations ['93157b76-6bcd-4d24-a1ca-b341fffd6d0b', 'c0854a94-b5df-449f-bbe8-6d1dcd58cd26', '368c7e00-9984-44b1-9db4-47ccbd93ad00', '3979cce9-b968-4259-9f0d-2093ebb1e376'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:15 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:31:15 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:15 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.373s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:31:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Deleted volume successfully. Aug 04 12:31:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1063ad01-1f33-47f1-b30c-56b101880238 tempest-VolumeSnapshotQuotasNegativeTestJSON-1414139118 None] Lock "cinder-6764d9b4-b126-4b02-b440-999834dce747-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:25 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=60,cinder:INSERT=16,cinder:SELECT=58,cinder:DELETE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:31:25 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=58,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=14 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Flow 'volume_create_manager' (7700d469-0d04-494f-96a0-b4d40ee759c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602f04a6-8281-41e4-8c8b-bbe7c80c47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602f04a6-8281-41e4-8c8b-bbe7c80c47b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-128542020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab88071e-084c-4939-bab6-e518020846c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2445b3bd7d47d8b8e2780ff34534b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:29Z,use_quota=True,user_id='6aa8f51cd90644f9a2468026043acfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0018a3ec-1736-46cb-99cf-ac48de48a008),volume_type_id=0018a3ec-1736-46cb-99cf-ac48de48a008)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a6785a-a378-453f-83d6-d97ea510eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a6785a-a378-453f-83d6-d97ea510eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3ed5a2-b36b-4141-bbde-e9818e4f1cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3ed5a2-b36b-4141-bbde-e9818e4f1cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab88071e-084c-4939-bab6-e518020846c1', 'volume_name': 'volume-ab88071e-084c-4939-bab6-e518020846c1', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d15d1e-7610-4361-ba4e-a71ca4331283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d15d1e-7610-4361-ba4e-a71ca4331283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e24715f-15e3-4f7c-ab4c-d8998f37e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Volume ab88071e-084c-4939-bab6-e518020846c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab88071e-084c-4939-bab6-e518020846c1', 'volume_size': 1} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-128542020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab88071e-084c-4939-bab6-e518020846c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2445b3bd7d47d8b8e2780ff34534b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:29Z,use_quota=True,user_id='6aa8f51cd90644f9a2468026043acfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0018a3ec-1736-46cb-99cf-ac48de48a008),volume_type_id=0018a3ec-1736-46cb-99cf-ac48de48a008)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Creating volume ab88071e-084c-4939-bab6-e518020846c1 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:31:29 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:31:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:29 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 1073741824 Aug 04 12:31:29 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:30 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 1073741824" returned: 0 in 0.672s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:30 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 Aug 04 12:31:30 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:30 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1" returned: 0 in 0.326s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e24715f-15e3-4f7c-ab4c-d8998f37e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab88071e-084c-4939-bab6-e518020846c1', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fdb1db-1ae7-4f53-9c33-16ac01df9130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:30 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Volume volume-ab88071e-084c-4939-bab6-e518020846c1 (ab88071e-084c-4939-bab6-e518020846c1): created successfully Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fdb1db-1ae7-4f53-9c33-16ac01df9130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Flow 'volume_create_manager' (7700d469-0d04-494f-96a0-b4d40ee759c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-abdb9908-92bf-42ab-9a7f-55dfe08997f2 tempest-VolumeTypesAccessTest-1520235172 None] Created volume successfully. Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Acquiring lock "cinder-ab88071e-084c-4939-bab6-e518020846c1-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "cinder-ab88071e-084c-4939-bab6-e518020846c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Acquiring lock "cinder-quobyte-ab88071e-084c-4939-bab6-e518020846c1" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "cinder-quobyte-ab88071e-084c-4939-bab6-e518020846c1" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af9d62e-1465-4424-81a3-57c51a60fc43]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:32 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 Aug 04 12:31:32 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:32 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1" returned: 0 in 0.502s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:32 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1 Aug 04 12:31:32 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:32 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ab88071e-084c-4939-bab6-e518020846c1" returned: 0 in 0.344s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "cinder-quobyte-ab88071e-084c-4939-bab6-e518020846c1" released by "delete_volume" :: held 0.922s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:32 devstack cinder-volume[88895]: WARNING cinder.quota [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-923694020 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-923694020, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:31:32 devstack cinder-volume[88895]: WARNING cinder.quota [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-923694020 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-923694020, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Created reservations ['148441aa-c37b-410c-977a-7a6c2552c780', '1cbfb093-1237-449d-b44c-6f66e233c3de', '2a4c2055-7f64-4221-91b0-014705964e46', 'bae1f6fd-e2aa-4065-84f3-d9752ff178c8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:32 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:31:32 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:33 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.329s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:33 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:31:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Deleted volume successfully. Aug 04 12:31:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8f338bef-ff40-4d2b-bdfd-a4bcb83daf48 tempest-VolumeTypesAccessTest-1520235172 None] Lock "cinder-ab88071e-084c-4939-bab6-e518020846c1-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Flow 'volume_create_manager' (06bcf7a9-fdf2-4d5e-8e94-4b50a25814f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e696e0de-2e57-4b71-acf9-cecbee32df4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e696e0de-2e57-4b71-acf9-cecbee32df4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1379769933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4068077d-928d-470a-845a-bc7f863a266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3fd51d63ec42969c70b1a20745ff0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:38Z,use_quota=True,user_id='d39291ce62da481ab8b17319f2288e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33842c61-ff29-4648-8dd5-9a58aef273a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33842c61-ff29-4648-8dd5-9a58aef273a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474406e3-3b62-4c49-8bd2-cb092db2fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474406e3-3b62-4c49-8bd2-cb092db2fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4068077d-928d-470a-845a-bc7f863a266f', 'volume_name': 'volume-4068077d-928d-470a-845a-bc7f863a266f', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4537e3c-4ec6-44f4-9722-10b0e19d34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4537e3c-4ec6-44f4-9722-10b0e19d34c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf700f5-f18e-4ad5-9f32-e6370628adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Volume 4068077d-928d-470a-845a-bc7f863a266f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4068077d-928d-470a-845a-bc7f863a266f', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 04 12:31:39 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Trying to clone 4068077d-928d-470a-845a-bc7f863a266f from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:31:39 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:31:39 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Image download 20.69 MB at 20.69 MB/s Aug 04 12:31:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a3032-5a4c-4b23-9e41-d052dcd3490f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:40 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD Aug 04 12:31:40 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:40 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD" returned: 0 in 0.679s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:40 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 is fetched for user d39291ce62da481ab8b17319f2288e3c. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:31:40 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a380bf6-43fe-4ec4-b71b-681e93d16821]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:40 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD Aug 04 12:31:40 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:41 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1379769933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4068077d-928d-470a-845a-bc7f863a266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3fd51d63ec42969c70b1a20745ff0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:38Z,use_quota=True,user_id='d39291ce62da481ab8b17319f2288e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Creating volume 4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:31:41 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:31:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:41 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1073741824 Aug 04 12:31:41 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:42 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1073741824" returned: 0 in 0.738s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:42 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f Aug 04 12:31:42 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:42 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f" returned: 0 in 0.653s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Attempting download of 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume 4068077d-928d-470a-845a-bc7f863a266f. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffac148-ee7d-4e26-bcc9-a6d9597366cd]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:43 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68 Aug 04 12:31:43 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:43 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68" returned: 0 in 0.616s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:43 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68 Aug 04 12:31:43 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:44 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68" returned: 1 in 0.682s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_8t0_1o68' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03bfcd3-4bee-41e9-972a-6a1c1a07808b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:44 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD Aug 04 12:31:44 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:44 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 was qcow2, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:31:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:44 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f Aug 04 12:31:44 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:47 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f" returned: 0 in 2.498s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_548f5761-1bd3-4329-ae55-bcd5aa6b3c29_vzmh4g0_devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:31:47 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Converted 112.00 MB image at 44.81 MB/s Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:47 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1G Aug 04 12:31:47 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Flow 'volume_create_manager' (71f8069c-8a5f-407b-9ace-6029824c14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7a88bf-b502-4d0c-98b0-a937e6d8b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7a88bf-b502-4d0c-98b0-a937e6d8b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1692100888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46dd038fd644108eece7556bd53b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:47Z,use_quota=True,user_id='88131a5f55344ebba51cd01a514eac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dedb0ac-7c24-465c-97e4-c10f7d2318e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dedb0ac-7c24-465c-97e4-c10f7d2318e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc3fac1-f3f5-4227-88cd-d909872f04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc3fac1-f3f5-4227-88cd-d909872f04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76', 'volume_name': 'volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126417fe-d1ad-438f-8076-21984cfd07cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126417fe-d1ad-438f-8076-21984cfd07cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3590acd-8910-406d-9901-3f628246563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Volume 8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76', 'volume_size': 1} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1692100888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46dd038fd644108eece7556bd53b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:47Z,use_quota=True,user_id='88131a5f55344ebba51cd01a514eac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Creating volume 8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:31:47 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:47 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 1073741824 Aug 04 12:31:47 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:47 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f 1G" returned: 0 in 0.616s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Downloaded image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 ((None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}])) to volume 4068077d-928d-470a-845a-bc7f863a266f successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Temporary image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 for user d39291ce62da481ab8b17319f2288e3c is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Marking volume 4068077d-928d-470a-845a-bc7f863a266f as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Copying metadata from image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 to 4068077d-928d-470a-845a-bc7f863a266f. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Creating volume glance metadata for volume 4068077d-928d-470a-845a-bc7f863a266f backed by image 548f5761-1bd3-4329-ae55-bcd5aa6b3c29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf700f5-f18e-4ad5-9f32-e6370628adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4068077d-928d-470a-845a-bc7f863a266f', 'volume_size': 1, 'image_id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '277f9636ca6546c682cd72ea1afbfd7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '548f5761-1bd3-4329-ae55-bcd5aa6b3c29', 'created_at': datetime.datetime(2026, 8, 4, 10, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 13, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/548f5761-1bd3-4329-ae55-bcd5aa6b3c29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2680335-1eda-4083-9945-151d3216b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Volume volume-4068077d-928d-470a-845a-bc7f863a266f (4068077d-928d-470a-845a-bc7f863a266f): created successfully Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2680335-1eda-4083-9945-151d3216b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Flow 'volume_create_manager' (06bcf7a9-fdf2-4d5e-8e94-4b50a25814f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-79652ace-39d9-4758-b42d-87fbfe27c6d5 tempest-TestShelveInstance-1948170893 None] Created volume successfully. Aug 04 12:31:48 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 1073741824" returned: 0 in 0.711s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:48 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:31:48 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:48 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.373s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3590acd-8910-406d-9901-3f628246563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf640703-be8d-4d9e-91b8-a8950b817564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Volume volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 (8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76): created successfully Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf640703-be8d-4d9e-91b8-a8950b817564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Flow 'volume_create_manager' (71f8069c-8a5f-407b-9ace-6029824c14d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9548a4ee-cfeb-4892-aa8c-270512e76043 tempest-TestStampPattern-1356011074 None] Created volume successfully. Aug 04 12:31:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eb9d81a4-33ed-4eb2-a5e9-147d620704a3 req-3f7d29e8-746c-4dbc-a63a-148c8f7004fe tempest-TestShelveInstance-1948170893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eb9d81a4-33ed-4eb2-a5e9-147d620704a3 req-3f7d29e8-746c-4dbc-a63a-148c8f7004fe tempest-TestShelveInstance-1948170893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-eb9d81a4-33ed-4eb2-a5e9-147d620704a3 req-3f7d29e8-746c-4dbc-a63a-148c8f7004fe tempest-TestShelveInstance-1948170893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-eb9d81a4-33ed-4eb2-a5e9-147d620704a3 req-3f7d29e8-746c-4dbc-a63a-148c8f7004fe tempest-TestShelveInstance-1948170893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-4068077d-928d-470a-845a-bc7f863a266f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6289767-4c8a-48ae-9d07-5ab48a3f094d', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:31:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-eb9d81a4-33ed-4eb2-a5e9-147d620704a3 req-3f7d29e8-746c-4dbc-a63a-148c8f7004fe tempest-TestShelveInstance-1948170893 None] attachment_update completed successfully. Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (da8d13b5-8a69-49ab-8440-7294424e7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065f49a-51d7-4194-927f-5963b493ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b065f49a-51d7-4194-927f-5963b493ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059171471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aa7b74-bc41-4322-a1a6-63c18da78e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4612d25908c4bf6821af6f276579651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:54Z,use_quota=True,user_id='8d5a6522f98e4a218f744381097161fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a04e43-49fd-4214-8660-ca8378525c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a04e43-49fd-4214-8660-ca8378525c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f40caaf-6105-46dc-820b-003a24fae6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f40caaf-6105-46dc-820b-003a24fae6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2aa7b74-bc41-4322-a1a6-63c18da78e58', 'volume_name': 'volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee66665a-ef35-42c9-b340-d9d7963e852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee66665a-ef35-42c9-b340-d9d7963e852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f585d88-673d-4aac-993b-6c26b7e2e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Volume a2aa7b74-bc41-4322-a1a6-63c18da78e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58', 'volume_size': 1} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059171471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aa7b74-bc41-4322-a1a6-63c18da78e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4612d25908c4bf6821af6f276579651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:31:54Z,use_quota=True,user_id='8d5a6522f98e4a218f744381097161fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Creating volume a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:31:53 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:31:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:53 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 1073741824 Aug 04 12:31:53 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:54 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 1073741824" returned: 0 in 0.495s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:54 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 Aug 04 12:31:54 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:54 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58" returned: 0 in 0.311s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f585d88-673d-4aac-993b-6c26b7e2e553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2568a242-0212-4544-8adc-7ffcd01c5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:31:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Volume volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 (a2aa7b74-bc41-4322-a1a6-63c18da78e58): created successfully Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2568a242-0212-4544-8adc-7ffcd01c5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:31:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (da8d13b5-8a69-49ab-8440-7294424e7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:31:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d8cbe187-dc7f-42e1-8bfb-cb80dd7dd893 tempest-VolumesDeleteCascade-146545537 None] Created volume successfully. Aug 04 12:31:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:31:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:31:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Creating offline snapshot 9dea23f9-3184-4eec-9aa3-7864d3de1f3f of volume a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:31:56 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd559d-312c-473a-8e34-3dd06e10d7cc]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:31:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:56 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 Aug 04 12:31:56 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:56 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58" returned: 0 in 0.743s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:56 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f 1G Aug 04 12:31:56 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:57 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f 1G" returned: 0 in 0.913s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:57 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:31:57 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:58 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.784s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:58 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f is being set with open permissions: ugo+rw Aug 04 12:31:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:58 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:31:58 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:58 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.445s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:59 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info Aug 04 12:31:59 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:59 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info" returned: 0 in 0.577s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:59 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info is being set with open permissions: ugo+rw Aug 04 12:31:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:31:59 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info Aug 04 12:31:59 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:31:59 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Aug 04 12:31:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.info" returned: 0 in 0.345s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:31:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c20d2259-959f-4e4c-a748-eefff0eef028 tempest-VolumesDeleteCascade-146545537 None] Create snapshot completed successfully Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Creating offline snapshot 20c9567d-86df-4aa2-ad6a-95dee3895deb of volume a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7edf038-2c47-4fa7-8db5-04421e1aa3a8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:01 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:32:01 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:01 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.627s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:01 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb 1G Aug 04 12:32:01 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:02 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb 1G" returned: 0 in 1.014s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:02 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb Aug 04 12:32:02 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:03 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb" returned: 0 in 0.645s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:03 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb is being set with open permissions: ugo+rw Aug 04 12:32:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:03 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb Aug 04 12:32:03 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:04 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb" returned: 0 in 0.678s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-09f88226-742c-482c-a3f7-f39c5aa257aa tempest-VolumesDeleteCascade-146545537 None] Create snapshot completed successfully Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-a2aa7b74-bc41-4322-a1a6-63c18da78e58-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-a2aa7b74-bc41-4322-a1a6-63c18da78e58-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Performing cascade delete. {{(pid=88895) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-20c9567d-86df-4aa2-ad6a-95dee3895deb-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-20c9567d-86df-4aa2-ad6a-95dee3895deb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-20c9567d-86df-4aa2-ad6a-95dee3895deb" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-20c9567d-86df-4aa2-ad6a-95dee3895deb" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Deleting offline snapshot 20c9567d-86df-4aa2-ad6a-95dee3895deb of volume a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] snapshot_file for this snap is: volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc3777b-3150-4594-8dbe-416dbbdf37f4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:06 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb Aug 04 12:32:06 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:06 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:06 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:06 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.624s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:32:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:32:07 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb" returned: 0 in 1.107s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c4dff-f8b2-448b-8fb6-7ef26437e501]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:07 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:32:07 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-243c9c4f-4f53-45e4-b6ae-10dca605d23d req-82537c19-da1d-4013-bced-c0fa9c6211b0 tempest-TestMinimumBasicScenario-1840342048 None] Terminate volume connection completed successfully. Aug 04 12:32:07 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-243c9c4f-4f53-45e4-b6ae-10dca605d23d req-82537c19-da1d-4013-bced-c0fa9c6211b0 tempest-TestMinimumBasicScenario-1840342048 None] Deleting attachment d02dd93b-001c-4c0f-bb0f-c9abbcd7ba34. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:32:08 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 1.185s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:08 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb Aug 04 12:32:08 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:08 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb" returned: 0 in 0.473s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:08 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb Aug 04 12:32:08 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:09 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.20c9567d-86df-4aa2-ad6a-95dee3895deb" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-20c9567d-86df-4aa2-ad6a-95dee3895deb" released by "_delete_snapshot" :: held 3.312s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" released by "delete_snapshot" :: held 3.384s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Created reservations ['42b4300a-3fb6-4e66-a70c-39601c003fd6', '3d622285-b411-46dd-8f82-ded85da3456f', '7b47c670-e25c-4b6b-acdc-bc7f0d8750db', 'ac8408c8-da01-4299-a191-08e8a06936ee'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "cinder-a44c8f1b-499f-4dff-a840-8d099e53f35d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Delete snapshot completed successfully. Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-20c9567d-86df-4aa2-ad6a-95dee3895deb-delete_snapshot" released by "delete_snapshot" :: held 3.791s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-9dea23f9-3184-4eec-9aa3-7864d3de1f3f-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "cinder-a44c8f1b-499f-4dff-a840-8d099e53f35d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-9dea23f9-3184-4eec-9aa3-7864d3de1f3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "cinder-quobyte-a44c8f1b-499f-4dff-a840-8d099e53f35d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-9dea23f9-3184-4eec-9aa3-7864d3de1f3f" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "cinder-quobyte-a44c8f1b-499f-4dff-a840-8d099e53f35d" acquired by "delete_volume" :: waited 0.047s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-9dea23f9-3184-4eec-9aa3-7864d3de1f3f" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Deleting offline snapshot 9dea23f9-3184-4eec-9aa3-7864d3de1f3f of volume a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] snapshot_file for this snap is: volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a984d1-193b-4bfd-b7f7-ed81e52cc05b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ecb02-6aaa-4772-893b-14f60be190b8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:10 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:32:10 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:10 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d Aug 04 12:32:10 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:10 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.731s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32deab-a33f-4ffc-95e6-97398503ea6d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:10 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d" returned: 0 in 0.842s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:10 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d Aug 04 12:32:10 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:10 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 Aug 04 12:32:10 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:11 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a44c8f1b-499f-4dff-a840-8d099e53f35d" returned: 0 in 0.512s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "cinder-quobyte-a44c8f1b-499f-4dff-a840-8d099e53f35d" released by "delete_volume" :: held 1.443s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Created reservations ['e7f26c99-76c2-472d-a8b2-9f9bd127cfde', '8fc8df6c-ca13-47ed-b5a7-480188558cc3', 'bf8c6018-699b-4026-9521-44cc27f7e9e3', 'a8463baa-f832-4b58-b0d9-8fc9b2a215b7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:11 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58" returned: 0 in 0.803s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:11 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:32:11 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:11 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:11 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:12 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.384s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Deleted volume successfully. Aug 04 12:32:12 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.646s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7ae4cf4c-6ff3-452d-a4eb-c1cd1f262f74 tempest-TestMinimumBasicScenario-1840342048 None] Lock "cinder-a44c8f1b-499f-4dff-a840-8d099e53f35d-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:12 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f Aug 04 12:32:12 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:12 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58.9dea23f9-3184-4eec-9aa3-7864d3de1f3f" returned: 0 in 0.447s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-9dea23f9-3184-4eec-9aa3-7864d3de1f3f" released by "_delete_snapshot" :: held 2.794s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" released by "delete_snapshot" :: held 2.869s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Created reservations ['0d99457b-7152-48b1-8fe6-4dc4047fab92', 'a9ee43ca-f64f-4f56-a080-731af30f8607', '1284e4e1-90a2-4f1a-80bd-0b724d4cb833', 'a4ee1ff7-4dcb-47a7-aee4-f7bd2e8591a5'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:12 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Delete snapshot completed successfully. Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-9dea23f9-3184-4eec-9aa3-7864d3de1f3f-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Snapshots deleted, issuing volume delete {{(pid=88895) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" acquired by "delete_volume" :: waited 0.064s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5efa9a5-3386-4bdd-8ecb-52a093af7298]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:13 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 Aug 04 12:32:13 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:13 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58" returned: 0 in 0.479s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:13 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58 Aug 04 12:32:13 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:14 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a2aa7b74-bc41-4322-a1a6-63c18da78e58" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-a2aa7b74-bc41-4322-a1a6-63c18da78e58" released by "delete_volume" :: held 1.168s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Created reservations ['30b2cd60-507f-45ce-84ec-8ddce4a0f53a', 'd19e28ae-bdb3-4011-8285-50f0df874b59', 'dcb6e87c-02a7-45cc-9e26-753d7dbdd58a', '89fa311c-04cb-46d0-98cb-ecddcf55685d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:14 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:14 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:14 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Deleted volume successfully. Aug 04 12:32:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0ce29ab1-51d1-4391-91a2-e13972620e2b tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-a2aa7b74-bc41-4322-a1a6-63c18da78e58-delete_volume" released by "delete_volume" :: held 8.905s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (f32c7e09-fc66-4f10-9fb7-0e40b27933a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eef222-56f9-4ffe-a2ca-d97040a724ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eef222-56f9-4ffe-a2ca-d97040a724ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-936543948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b30c5db-68cd-4139-b26c-d8a9bd139b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4612d25908c4bf6821af6f276579651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:16Z,use_quota=True,user_id='8d5a6522f98e4a218f744381097161fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427a35f-b0c5-4259-aa95-7bfb0fc99a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427a35f-b0c5-4259-aa95-7bfb0fc99a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85723ccc-1e12-4307-b839-18dacf5f2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85723ccc-1e12-4307-b839-18dacf5f2a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b30c5db-68cd-4139-b26c-d8a9bd139b3a', 'volume_name': 'volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acb3bbb-4919-453e-a76a-89f355c7fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acb3bbb-4919-453e-a76a-89f355c7fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e925b25f-5def-41ee-aa0e-a5682361f8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Volume 1b30c5db-68cd-4139-b26c-d8a9bd139b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a', 'volume_size': 1} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-936543948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b30c5db-68cd-4139-b26c-d8a9bd139b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4612d25908c4bf6821af6f276579651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:16Z,use_quota=True,user_id='8d5a6522f98e4a218f744381097161fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Creating volume 1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:32:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:32:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:16 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a 1073741824 Aug 04 12:32:16 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:16 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a 1073741824" returned: 0 in 0.558s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:16 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:16 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:16 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e925b25f-5def-41ee-aa0e-a5682361f8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97bc841-1444-40b6-8585-13570d1b5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Volume volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a (1b30c5db-68cd-4139-b26c-d8a9bd139b3a): created successfully Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97bc841-1444-40b6-8585-13570d1b5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (f32c7e09-fc66-4f10-9fb7-0e40b27933a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-eded2614-8411-4fc8-b752-9637d70d7bae tempest-VolumesDeleteCascade-146545537 None] Created volume successfully. Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Creating offline snapshot 541ca44e-9435-450e-b87c-f1e58e18bdf1 of volume 1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[98731d38-1676-4c25-a207-7183b98d46c9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:18 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:18 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:18 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.542s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:18 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 1G Aug 04 12:32:18 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:19 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 1G" returned: 0 in 0.558s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:19 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:19 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:19 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.415s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:19 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 is being set with open permissions: ugo+rw Aug 04 12:32:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:19 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:19 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:20 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.417s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:20 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info Aug 04 12:32:20 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:20 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:20 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info is being set with open permissions: ugo+rw Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:20 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info Aug 04 12:32:20 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:20 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.info" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e7334120-966d-4f1a-8e2d-ba7740bb27a6 tempest-VolumesDeleteCascade-146545537 None] Create snapshot completed successfully Aug 04 12:32:21 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (d28e201a-8e51-43dd-aff6-46f68b677dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2336b7c-fd18-4725-a244-8edf2e06ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2336b7c-fd18-4725-a244-8edf2e06ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2041405308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf84bd21-f702-459e-a748-c862db8afe07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4612d25908c4bf6821af6f276579651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=541ca44e-9435-450e-b87c-f1e58e18bdf1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:22Z,use_quota=True,user_id='8d5a6522f98e4a218f744381097161fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6086818-3610-4b77-a49f-4ea6fd523cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6086818-3610-4b77-a49f-4ea6fd523cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ee37dc-bce0-46bc-9efd-5707ab62bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ee37dc-bce0-46bc-9efd-5707ab62bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf84bd21-f702-459e-a748-c862db8afe07', 'volume_name': 'volume-bf84bd21-f702-459e-a748-c862db8afe07', 'volume_size': 1, 'snapshot_id': '541ca44e-9435-450e-b87c-f1e58e18bdf1'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c2f8b7-c2e9-4ccc-81e7-076385a6b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c2f8b7-c2e9-4ccc-81e7-076385a6b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa0c3e-12b9-43bb-ba55-35ed42713e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Volume bf84bd21-f702-459e-a748-c862db8afe07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf84bd21-f702-459e-a748-c862db8afe07', 'volume_size': 1, 'snapshot_id': '541ca44e-9435-450e-b87c-f1e58e18bdf1'} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1-bf84bd21-f702-459e-a748-c862db8afe07" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1-bf84bd21-f702-459e-a748-c862db8afe07" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Creating volume bf84bd21-f702-459e-a748-c862db8afe07 from snapshot 541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] snapshot: 541ca44e-9435-450e-b87c-f1e58e18bdf1, volume: bf84bd21-f702-459e-a748-c862db8afe07, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6cb077-5d01-4d08-9a75-87c100f007f6]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:22 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:22 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:22 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.430s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d354ad-eeba-451f-adda-672038d7012c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:22 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:22 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:23 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.472s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:32:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:32:23 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:32:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:23 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 Aug 04 12:32:23 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:26 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=54,cinder:DELETE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:32:26 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=62,cinder:UPDATE=62,cinder:INSERT=16,cinder:DELETE=6 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:32:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-62e1a9c7-16f7-4ed3-b9bd-e4e7f31317b7 req-8deb5589-6da7-4ca7-8505-0ec128237386 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07" returned: 0 in 5.759s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:28 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:32:28 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Converted 1024.00 MB image at 177.78 MB/s Aug 04 12:32:28 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 is being set with open permissions: ugo+rw Aug 04 12:32:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:28 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 Aug 04 12:32:28 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:29 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07" returned: 0 in 0.258s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" released by "_copy_volume_from_snapshot" :: held 7.022s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1-bf84bd21-f702-459e-a748-c862db8afe07" released by "_create_volume_from_snapshot" :: held 7.108s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.124s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-62e1a9c7-16f7-4ed3-b9bd-e4e7f31317b7 req-8deb5589-6da7-4ca7-8505-0ec128237386 tempest-TestStampPattern-1356011074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.938s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-62e1a9c7-16f7-4ed3-b9bd-e4e7f31317b7 req-8deb5589-6da7-4ca7-8505-0ec128237386 tempest-TestStampPattern-1356011074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7aa0c3e-12b9-43bb-ba55-35ed42713e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf84bd21-f702-459e-a748-c862db8afe07', 'volume_size': 1, 'snapshot_id': '541ca44e-9435-450e-b87c-f1e58e18bdf1'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793797cb-70ea-4d51-8f0f-0d90d947e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Volume volume-bf84bd21-f702-459e-a748-c862db8afe07 (bf84bd21-f702-459e-a748-c862db8afe07): created successfully Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793797cb-70ea-4d51-8f0f-0d90d947e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Flow 'volume_create_manager' (d28e201a-8e51-43dd-aff6-46f68b677dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-62e1a9c7-16f7-4ed3-b9bd-e4e7f31317b7 req-8deb5589-6da7-4ca7-8505-0ec128237386 tempest-TestStampPattern-1356011074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '307acb02-a082-46a1-8b7a-5b989c1cff76', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:32:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6a5019cb-ad09-42e3-9ce9-6ff12e68a858 tempest-VolumesDeleteCascade-146545537 None] Created volume successfully. Aug 04 12:32:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-62e1a9c7-16f7-4ed3-b9bd-e4e7f31317b7 req-8deb5589-6da7-4ca7-8505-0ec128237386 tempest-TestStampPattern-1356011074 None] attachment_update completed successfully. Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-1b30c5db-68cd-4139-b26c-d8a9bd139b3a-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-1b30c5db-68cd-4139-b26c-d8a9bd139b3a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Performing cascade delete. {{(pid=88895) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-541ca44e-9435-450e-b87c-f1e58e18bdf1-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-541ca44e-9435-450e-b87c-f1e58e18bdf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Deleting offline snapshot 541ca44e-9435-450e-b87c-f1e58e18bdf1 of volume 1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] snapshot_file for this snap is: volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17017a-145e-418c-86b3-85517eb64731]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:30 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:30 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:31 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.554s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7592e-e7fb-4a98-988c-cf4e5e4066a1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:31 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:31 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:31 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.730s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:31 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:31 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:32 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.524s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:32 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1 Aug 04 12:32:32 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:32 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a.541ca44e-9435-450e-b87c-f1e58e18bdf1" returned: 0 in 0.348s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-541ca44e-9435-450e-b87c-f1e58e18bdf1" released by "_delete_snapshot" :: held 2.321s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" released by "delete_snapshot" :: held 2.359s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Created reservations ['f8c0f8bb-a4d2-467c-8e1d-9e2d99c6bfc8', 'b7ce0965-ebde-4473-9fe8-b99c96873d90', 'e7bc159c-2ab9-4a5f-aa5c-98d6f0fcf19a', 'b08bd2bf-b14f-4db4-b9a6-7cf3e36a873f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Delete snapshot completed successfully. Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-541ca44e-9435-450e-b87c-f1e58e18bdf1-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Snapshots deleted, issuing volume delete {{(pid=88895) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a626e9-037f-4238-8857-fcd4383a3877]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:33 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:33 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:33 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.462s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:33 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a Aug 04 12:32:33 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:33 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" returned: 0 in 0.452s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-1b30c5db-68cd-4139-b26c-d8a9bd139b3a" released by "delete_volume" :: held 1.022s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Created reservations ['16e387e2-9c27-40a8-af62-0e38ef78a0ec', 'b47f82f7-2c90-4896-becf-51d03b52de29', 'd073a32c-bc7d-4b96-a08d-b4094016e0f9', '157be41b-d124-4670-9dde-06c82ede8c84'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:34 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:34 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-dac2dade-da8f-449f-9dd2-1ab254e8da3a req-c8288a1e-a1a1-4ea4-a318-2a2bf554c4bd tempest-TestShelveInstance-1948170893 None] Terminate volume connection completed successfully. Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-dac2dade-da8f-449f-9dd2-1ab254e8da3a req-c8288a1e-a1a1-4ea4-a318-2a2bf554c4bd tempest-TestShelveInstance-1948170893 None] Deleting attachment d6289767-4c8a-48ae-9d07-5ab48a3f094d. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:32:34 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Deleted volume successfully. Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b8f87010-3f40-4c4a-aaf3-ec0736610666 tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-1b30c5db-68cd-4139-b26c-d8a9bd139b3a-delete_volume" released by "delete_volume" :: held 4.482s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-bf84bd21-f702-459e-a748-c862db8afe07-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-bf84bd21-f702-459e-a748-c862db8afe07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7805f37-6bcf-4bf3-b425-7558144448e9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-243cbbf9-ebe0-4429-92c2-9423a9ad975f req-bc1a0101-ebcf-4ba2-9349-c9d7e6f1de0f tempest-TestStampPattern-1356011074 None] Terminate volume connection completed successfully. Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-243cbbf9-ebe0-4429-92c2-9423a9ad975f req-bc1a0101-ebcf-4ba2-9349-c9d7e6f1de0f tempest-TestStampPattern-1356011074 None] Deleting attachment 307acb02-a082-46a1-8b7a-5b989c1cff76. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:32:35 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 Aug 04 12:32:35 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:35 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07" returned: 0 in 0.550s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:35 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07 Aug 04 12:32:35 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:36 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bf84bd21-f702-459e-a748-c862db8afe07" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-quobyte-bf84bd21-f702-459e-a748-c862db8afe07" released by "delete_volume" :: held 0.966s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Creating offline snapshot 79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 of volume 8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b650da-ec63-47f8-a19d-d594f7b39b64]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Created reservations ['5a8e7bc8-eb0a-4b94-9bc6-f1dae715a23b', '6f96e871-73ea-48c6-9088-8fab4f16cc12', 'b315a164-4fd2-4f45-b684-d47d83165c2a', 'efc1cd59-5f67-4c85-8557-44bce38490ae'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:36 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:32:36 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:36 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:36 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:36 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.516s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:36 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.365s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Deleted volume successfully. Aug 04 12:32:36 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 1G Aug 04 12:32:36 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e6b466a3-06e6-450e-beb3-b7d0763bcbed tempest-VolumesDeleteCascade-146545537 None] Lock "cinder-bf84bd21-f702-459e-a748-c862db8afe07-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:37 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 1G" returned: 0 in 0.663s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:37 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:32:37 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:37 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.480s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:37 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 is being set with open permissions: ugo+rw Aug 04 12:32:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:37 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:32:37 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-39ecd423-d34c-4c42-9075-ffbd9fccb868 req-24fd3467-8d96-4982-b887-4699cf7b527d tempest-TestShelveInstance-1948170893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:38 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.418s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:38 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info Aug 04 12:32:38 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:38 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:38 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info is being set with open permissions: ugo+rw Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:38 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info Aug 04 12:32:38 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:38 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.info" returned: 0 in 0.292s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-39ecd423-d34c-4c42-9075-ffbd9fccb868 req-24fd3467-8d96-4982-b887-4699cf7b527d tempest-TestShelveInstance-1948170893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.682s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-39ecd423-d34c-4c42-9075-ffbd9fccb868 req-24fd3467-8d96-4982-b887-4699cf7b527d tempest-TestShelveInstance-1948170893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ecf54c04-1d3e-4ce6-b9ef-111e47b2ae3f tempest-TestStampPattern-1356011074 None] Create snapshot completed successfully Aug 04 12:32:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-39ecd423-d34c-4c42-9075-ffbd9fccb868 req-24fd3467-8d96-4982-b887-4699cf7b527d tempest-TestShelveInstance-1948170893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-4068077d-928d-470a-845a-bc7f863a266f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf5c9d1e-ec98-4461-beba-aa8e46bf60b4', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:32:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-39ecd423-d34c-4c42-9075-ffbd9fccb868 req-24fd3467-8d96-4982-b887-4699cf7b527d tempest-TestShelveInstance-1948170893 None] attachment_update completed successfully. Aug 04 12:32:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:32:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Flow 'volume_create_manager' (9b40120e-8dac-4aaf-9202-0d74207fad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ca8327-afab-46b1-9c44-b69a2b4729b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ca8327-afab-46b1-9c44-b69a2b4729b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1284274365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af231cd636834929b0ede758c9689e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:45Z,use_quota=True,user_id='874ca2bb64ff454f9a46af44c995beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c78cd-c777-4216-83dc-6a4573137f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c78cd-c777-4216-83dc-6a4573137f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c116762e-1d69-4195-8118-7c0e2654c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c116762e-1d69-4195-8118-7c0e2654c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7', 'volume_name': 'volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af7da74-e0c4-4af6-a93e-636cfcc0598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af7da74-e0c4-4af6-a93e-636cfcc0598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31769335-4710-4fce-9314-ee28902b1b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Volume 4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7', 'volume_size': 1} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1284274365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af231cd636834929b0ede758c9689e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:45Z,use_quota=True,user_id='874ca2bb64ff454f9a46af44c995beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Creating volume 4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:32:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:45 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 1073741824 Aug 04 12:32:45 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:45 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 1073741824" returned: 0 in 0.734s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:45 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 Aug 04 12:32:45 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:46 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" returned: 0 in 0.374s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31769335-4710-4fce-9314-ee28902b1b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940197df-78f5-44cf-9766-795a2e0c2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Volume volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 (4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7): created successfully Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940197df-78f5-44cf-9766-795a2e0c2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Flow 'volume_create_manager' (9b40120e-8dac-4aaf-9202-0d74207fad50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-adc25ca4-1c03-492a-a57b-f877798b781f tempest-VolumesTransfersV357Test-2026713390 None] Created volume successfully. Aug 04 12:32:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d7e30c4a-66b3-45cd-9d15-d0afdd4b8a15 tempest-VolumesTransfersV357Test-768740381 None] Transfer volume completed successfully. Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "cinder-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Flow 'volume_create_manager' (9298fb58-d711-424c-87bc-9369a516f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adcc100-ca99-40f9-914a-bb12925bbe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "cinder-quobyte-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adcc100-ca99-40f9-914a-bb12925bbe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1995480328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b5ca46-5ecd-4fe2-ad2b-884167899282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46dd038fd644108eece7556bd53b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79d35f2c-5d37-4c75-a5de-eb70a21fbcb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:49Z,use_quota=True,user_id='88131a5f55344ebba51cd01a514eac82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21581402-8ac9-477b-a889-5fadbdf97424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21581402-8ac9-477b-a889-5fadbdf97424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460dc867-5cae-4c56-aec2-b3a75156db9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460dc867-5cae-4c56-aec2-b3a75156db9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22b5ca46-5ecd-4fe2-ad2b-884167899282', 'volume_name': 'volume-22b5ca46-5ecd-4fe2-ad2b-884167899282', 'volume_size': 1, 'snapshot_id': '79d35f2c-5d37-4c75-a5de-eb70a21fbcb8'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76299086-da29-4d6c-a8b0-b4fc77dbcd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76299086-da29-4d6c-a8b0-b4fc77dbcd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a44df74-5321-4244-b861-d0ca8e7b26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:49 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Volume 22b5ca46-5ecd-4fe2-ad2b-884167899282: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22b5ca46-5ecd-4fe2-ad2b-884167899282', 'volume_size': 1, 'snapshot_id': '79d35f2c-5d37-4c75-a5de-eb70a21fbcb8'} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-quobyte-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" acquired by "delete_volume" :: waited 0.074s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-22b5ca46-5ecd-4fe2-ad2b-884167899282" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-22b5ca46-5ecd-4fe2-ad2b-884167899282" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Creating volume 22b5ca46-5ecd-4fe2-ad2b-884167899282 from snapshot 79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db0bad-a811-4efc-884b-412befb348f9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] snapshot: 79d35f2c-5d37-4c75-a5de-eb70a21fbcb8, volume: 22b5ca46-5ecd-4fe2-ad2b-884167899282, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[01145b61-e71c-4d39-bfa4-b5a51471e5c8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:49 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 Aug 04 12:32:49 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:49 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:32:49 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:50 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" returned: 0 in 0.592s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:50 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.522s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:32:50 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7 Aug 04 12:32:50 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c63951-2cd7-4cdb-80dd-959de6bf8ab3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:50 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:32:50 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:50 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" returned: 0 in 0.756s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-quobyte-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7" released by "delete_volume" :: held 1.443s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Created reservations ['3b795dd7-5d0e-48e0-8b54-7a33d8d46fda', '544ff015-40ea-4cfc-b5f2-41217cd1fe8c', 'bedd418b-869b-4f89-a473-81161f9479c2', '7107a0f3-5b65-4a36-a72f-6e3dc3c9752e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:32:51 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.867s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:51 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 Aug 04 12:32:51 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:51 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:32:51 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:32:51 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.487s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:32:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Deleted volume successfully. Aug 04 12:32:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-67b40f09-fcb6-4954-a566-b11f7fcfc736 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-4aaa87a1-9a6e-4ded-b8c5-8e2dc9b910e7-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Flow 'volume_create_manager' (a4944bfb-9431-4b37-8ef8-9d0378a841ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763fd951-16dd-4ae8-b0b1-865e5f4ff497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763fd951-16dd-4ae8-b0b1-865e5f4ff497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-373335744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f246aeb9-f0c4-435c-beff-7171f134096b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af231cd636834929b0ede758c9689e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:54Z,use_quota=True,user_id='874ca2bb64ff454f9a46af44c995beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8874ce42-ff14-40da-b381-e838d4ff862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8874ce42-ff14-40da-b381-e838d4ff862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c59b05-5c6c-4109-a1da-34ed37e08494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c59b05-5c6c-4109-a1da-34ed37e08494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f246aeb9-f0c4-435c-beff-7171f134096b', 'volume_name': 'volume-f246aeb9-f0c4-435c-beff-7171f134096b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78863bd-c5b0-4fdc-ae86-b2ecb5d74f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78863bd-c5b0-4fdc-ae86-b2ecb5d74f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56645d8-6ee1-4ca6-befe-ac14c80cb3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:32:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Volume f246aeb9-f0c4-435c-beff-7171f134096b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f246aeb9-f0c4-435c-beff-7171f134096b', 'volume_size': 1} Aug 04 12:32:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:32:59 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Aug 04 12:32:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282" returned: 0 in 8.718s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:32:59 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:32:59 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Converted 1024.00 MB image at 117.44 MB/s Aug 04 12:32:59 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 is being set with open permissions: ugo+rw Aug 04 12:32:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:32:59 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 Aug 04 12:32:59 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:00 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282" returned: 0 in 0.353s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" released by "_copy_volume_from_snapshot" :: held 10.608s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-22b5ca46-5ecd-4fe2-ad2b-884167899282" released by "_create_volume_from_snapshot" :: held 10.709s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.734s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.763s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-373335744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f246aeb9-f0c4-435c-beff-7171f134096b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af231cd636834929b0ede758c9689e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:32:54Z,use_quota=True,user_id='874ca2bb64ff454f9a46af44c995beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Creating volume f246aeb9-f0c4-435c-beff-7171f134096b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:00 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:00 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b 1073741824 Aug 04 12:33:00 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a44df74-5321-4244-b861-d0ca8e7b26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b5ca46-5ecd-4fe2-ad2b-884167899282', 'volume_size': 1, 'snapshot_id': '79d35f2c-5d37-4c75-a5de-eb70a21fbcb8'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb60d3d-2244-45d4-8bcd-03e77cf81fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Volume volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 (22b5ca46-5ecd-4fe2-ad2b-884167899282): created successfully Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb60d3d-2244-45d4-8bcd-03e77cf81fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Flow 'volume_create_manager' (9298fb58-d711-424c-87bc-9369a516f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ce51a3d4-d4ae-40cb-911b-14de8754523e tempest-TestStampPattern-1356011074 None] Created volume successfully. Aug 04 12:33:01 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b 1073741824" returned: 0 in 0.975s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:01 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b Aug 04 12:33:01 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:01 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b" returned: 0 in 0.427s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56645d8-6ee1-4ca6-befe-ac14c80cb3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f246aeb9-f0c4-435c-beff-7171f134096b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ad09f-8fcd-438e-a6a0-7e7ba4995b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Volume volume-f246aeb9-f0c4-435c-beff-7171f134096b (f246aeb9-f0c4-435c-beff-7171f134096b): created successfully Aug 04 12:33:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ad09f-8fcd-438e-a6a0-7e7ba4995b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Flow 'volume_create_manager' (a4944bfb-9431-4b37-8ef8-9d0378a841ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7792b91d-7fc4-41a7-8d09-77bace66d85e tempest-VolumesTransfersV357Test-2026713390 None] Created volume successfully. Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "cinder-f246aeb9-f0c4-435c-beff-7171f134096b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-f246aeb9-f0c4-435c-beff-7171f134096b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "cinder-quobyte-f246aeb9-f0c4-435c-beff-7171f134096b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-quobyte-f246aeb9-f0c4-435c-beff-7171f134096b" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af93c5-c215-4466-8cd3-1db25b1fa040]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:04 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b Aug 04 12:33:04 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:04 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b" returned: 0 in 0.576s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:04 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b Aug 04 12:33:04 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:05 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f246aeb9-f0c4-435c-beff-7171f134096b" returned: 0 in 0.740s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-quobyte-f246aeb9-f0c4-435c-beff-7171f134096b" released by "delete_volume" :: held 1.384s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Created reservations ['de0782eb-3b61-44f9-9daf-f557fa515fce', 'f4017da7-e561-43a8-a1da-28453d4edce6', 'c6d5c4f1-6a6a-4caf-a5c5-5c2a82a20b5d', '7ab9c1f0-b7ec-4bf9-a3f4-f6bbf4260edf'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:05 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:05 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:06 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.475s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Deleted volume successfully. Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2e461918-fbdd-4cfd-b616-8d0738e087d4 tempest-VolumesTransfersV357Test-1994960803 None] Lock "cinder-f246aeb9-f0c4-435c-beff-7171f134096b-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:06 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:06 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:06 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.545s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:33:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:33:15 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:INSERT=13,cinder:SELECT=52,cinder:UPDATE=50,cinder:DELETE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Flow 'volume_create_manager' (38d154f9-d05e-4b30-af38-89ce5f86305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a0fb14-f761-4b95-b63d-ac5bcc8dfd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a0fb14-f761-4b95-b63d-ac5bcc8dfd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2122811832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd53748-9fd4-4049-bc5a-7c201880144b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99c3b9255144f2893b87a6a9268a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:16Z,use_quota=True,user_id='2225c8e132ce48e4a38a5a5596d9d6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474abf49-c8ad-4104-9152-ff44864a7e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474abf49-c8ad-4104-9152-ff44864a7e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e43dde2-d6e8-41c7-b4db-bd152eb336a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e43dde2-d6e8-41c7-b4db-bd152eb336a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd53748-9fd4-4049-bc5a-7c201880144b', 'volume_name': 'volume-1fd53748-9fd4-4049-bc5a-7c201880144b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5080ac7-d8de-48a4-8b58-b064d7541b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5080ac7-d8de-48a4-8b58-b064d7541b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0edfea0-b5e8-4908-9cfd-d49b3bd75159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Volume 1fd53748-9fd4-4049-bc5a-7c201880144b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd53748-9fd4-4049-bc5a-7c201880144b', 'volume_size': 1} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2122811832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd53748-9fd4-4049-bc5a-7c201880144b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99c3b9255144f2893b87a6a9268a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:16Z,use_quota=True,user_id='2225c8e132ce48e4a38a5a5596d9d6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Creating volume 1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:16 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:16 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b 1073741824 Aug 04 12:33:16 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:17 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b 1073741824" returned: 0 in 1.073s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:17 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:17 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:17 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.417s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0edfea0-b5e8-4908-9cfd-d49b3bd75159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd53748-9fd4-4049-bc5a-7c201880144b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe09b3a-e739-4186-b782-4d7c4b796fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Volume volume-1fd53748-9fd4-4049-bc5a-7c201880144b (1fd53748-9fd4-4049-bc5a-7c201880144b): created successfully Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe09b3a-e739-4186-b782-4d7c4b796fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Flow 'volume_create_manager' (38d154f9-d05e-4b30-af38-89ce5f86305a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-79b542ba-a076-4d6a-ad8b-1b9151e02e3b tempest-VolumesCloneTest-1610345282 None] Created volume successfully. Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Flow 'volume_create_manager' (5565e783-1740-465f-b2ec-bbca29a2d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34787690-e52a-4ea5-8996-366a4aa0aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34787690-e52a-4ea5-8996-366a4aa0aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-623894656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2284ffc0-6f66-47b9-ac50-81766a94f331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99c3b9255144f2893b87a6a9268a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1fd53748-9fd4-4049-bc5a-7c201880144b,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:19Z,use_quota=True,user_id='2225c8e132ce48e4a38a5a5596d9d6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dadb50-aa90-4872-9b74-73665ff9e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dadb50-aa90-4872-9b74-73665ff9e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86582a93-08bb-473b-9652-952d6420016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86582a93-08bb-473b-9652-952d6420016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2284ffc0-6f66-47b9-ac50-81766a94f331', 'volume_name': 'volume-2284ffc0-6f66-47b9-ac50-81766a94f331', 'volume_size': 2, 'source_volid': '1fd53748-9fd4-4049-bc5a-7c201880144b', 'source_volstatus': 'available'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd2c30c-84d6-4040-81b8-523074ddcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd2c30c-84d6-4040-81b8-523074ddcc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49115164-4500-4788-9691-34f4ff7be188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:19 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Volume 2284ffc0-6f66-47b9-ac50-81766a94f331: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2284ffc0-6f66-47b9-ac50-81766a94f331', 'volume_size': 2, 'source_volid': '1fd53748-9fd4-4049-bc5a-7c201880144b', 'source_volstatus': 'available'} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:19 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Cloning volume 1fd53748-9fd4-4049-bc5a-7c201880144b to volume 2284ffc0-6f66-47b9-ac50-81766a94f331 Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Creating offline snapshot 87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d of volume 1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41a294-f9fc-4f19-9d45-f5f7577ad0de]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:19 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:19 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:19 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:19 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d 1G Aug 04 12:33:19 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:20 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d 1G" returned: 0 in 0.722s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd53748-9fd4-4049-bc5a-7c201880144b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:20 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd53748-9fd4-4049-bc5a-7c201880144b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:20 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:20 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd53748-9fd4-4049-bc5a-7c201880144b -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:20 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d is being set with open permissions: ugo+rw Aug 04 12:33:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:20 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:20 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:21 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:21 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info Aug 04 12:33:21 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:21 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info" returned: 0 in 0.346s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:21 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info is being set with open permissions: ugo+rw Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:21 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info Aug 04 12:33:21 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:21 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.info" returned: 0 in 0.293s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] snapshot: 87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d, volume: 2284ffc0-6f66-47b9-ac50-81766a94f331, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c56eae-d46e-4ebc-8449-042ba602c421]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:21 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:21 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:22 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd53748-9fd4-4049-bc5a-7c201880144b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3fb3ce-1ffa-4396-a54c-38e396df004a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:22 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:22 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:22 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.486s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:33:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:22 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 Aug 04 12:33:22 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:29 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331" returned: 0 in 6.262s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:33:29 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Converted 1024.00 MB image at 163.50 MB/s Aug 04 12:33:29 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 is being set with open permissions: ugo+rw Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:29 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 Aug 04 12:33:29 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:29 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331" returned: 0 in 0.261s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" released by "_copy_volume_from_snapshot" :: held 7.536s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=62,cinder:UPDATE=63,cinder:DELETE=4,cinder:INSERT=12 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-quobyte-87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Deleting offline snapshot 87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d of volume 1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] snapshot_file for this snap is: volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe305ae-3e4b-4dd7-a143-e6e6fa9f0374]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:29 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:29 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:29 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd53748-9fd4-4049-bc5a-7c201880144b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e98e7cc-ff97-476e-a503-31a3c2e6fadd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:29 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:29 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:30 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.614s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:30 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:30 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:30 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.363s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:30 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d Aug 04 12:33:30 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:31 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b.87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-87a32b7e-78b6-4ce1-b2d1-fc58c6fe337d" released by "_delete_snapshot" :: held 1.793s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.934s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49115164-4500-4788-9691-34f4ff7be188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2284ffc0-6f66-47b9-ac50-81766a94f331', 'volume_size': 2, 'source_volid': '1fd53748-9fd4-4049-bc5a-7c201880144b', 'source_volstatus': 'available'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a9ad7-f6c0-45eb-9d2d-9e5f9764cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Volume volume-2284ffc0-6f66-47b9-ac50-81766a94f331 (2284ffc0-6f66-47b9-ac50-81766a94f331): created successfully Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a9ad7-f6c0-45eb-9d2d-9e5f9764cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Flow 'volume_create_manager' (5565e783-1740-465f-b2ec-bbca29a2d07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8a4b26c8-74dc-4307-b3e9-f6df192a8087 tempest-VolumesCloneTest-1610345282 None] Created volume successfully. Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-2284ffc0-6f66-47b9-ac50-81766a94f331-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "cinder-2284ffc0-6f66-47b9-ac50-81766a94f331-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" acquired by "delete_volume" :: waited 0.044s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb85f7-e86e-4260-8344-a2b47a6517a4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:32 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 Aug 04 12:33:32 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:33 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331" returned: 0 in 0.901s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:33 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331 Aug 04 12:33:33 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:33 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2284ffc0-6f66-47b9-ac50-81766a94f331" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-2284ffc0-6f66-47b9-ac50-81766a94f331" released by "delete_volume" :: held 1.452s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Created reservations ['f4fc8afc-cf23-4f68-8044-3737b6dbea2a', '07070457-b29f-4db3-ad2f-b7ef1291efb1', 'ecad84d7-a5e6-46e9-9345-883468bbc36a', 'a1247826-49bd-4fb4-b12d-a642dfb7e314'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:33 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:33 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-bb642d3c-84f4-431e-823f-1b0d5fb7e80b tempest-TestShelveInstance-1948170893 None] Terminate volume connection completed successfully. Aug 04 12:33:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-bb642d3c-84f4-431e-823f-1b0d5fb7e80b tempest-TestShelveInstance-1948170893 None] Deleting attachment bf5c9d1e-ec98-4461-beba-aa8e46bf60b4. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Acquiring lock "cinder-4068077d-928d-470a-845a-bc7f863a266f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "cinder-4068077d-928d-470a-845a-bc7f863a266f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:34 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.295s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Deleted volume successfully. Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Acquiring lock "cinder-quobyte-4068077d-928d-470a-845a-bc7f863a266f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-21635ba4-bbd1-4637-979d-a4ec259a993f tempest-VolumesCloneTest-1610345282 None] Lock "cinder-2284ffc0-6f66-47b9-ac50-81766a94f331-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "cinder-quobyte-4068077d-928d-470a-845a-bc7f863a266f" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd62ec87-0eb2-4984-90c2-398d5e7450e2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:34 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f Aug 04 12:33:34 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-1fd53748-9fd4-4049-bc5a-7c201880144b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-1fd53748-9fd4-4049-bc5a-7c201880144b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "cinder-quobyte-1fd53748-9fd4-4049-bc5a-7c201880144b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-1fd53748-9fd4-4049-bc5a-7c201880144b" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352f96d-472e-4215-832b-bbc1b4f6efcd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:34 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f" returned: 0 in 0.464s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:34 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:34 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:34 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f Aug 04 12:33:34 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:35 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4068077d-928d-470a-845a-bc7f863a266f" returned: 0 in 0.297s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "cinder-quobyte-4068077d-928d-470a-845a-bc7f863a266f" released by "delete_volume" :: held 0.823s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:35 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:35 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b Aug 04 12:33:35 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.quota [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Created reservations ['0a4fb90a-11ae-4d3d-a48a-386c2d39411e', '6f6d1d8f-dfb4-4cd3-a78a-8190002c4e91', '3d6ccfe0-2d8a-4c31-930f-b51187a35bd5', '5aca2d5a-81cb-4b38-8e4a-7f5448fd6177'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:35 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:35 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:35 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1fd53748-9fd4-4049-bc5a-7c201880144b" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-quobyte-1fd53748-9fd4-4049-bc5a-7c201880144b" released by "delete_volume" :: held 0.983s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Created reservations ['bb4df1f4-ec25-4c6e-8b5e-1070704758b3', 'b6c8b7cb-b410-46bf-bbd8-8572e99da9cd', '2fc647e6-069e-4aff-8db8-c65e18f0aa33', '431f8a20-8a1a-4bb9-9d72-2a4a1f61335e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:35 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.470s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.manager [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Deleted volume successfully. Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [req-607787cf-1531-4edb-ba8f-e6d5d0f2a7c8 req-9f98d3f9-3ef9-41ff-9216-057fd6254efb tempest-TestShelveInstance-1948170893 None] Lock "cinder-4068077d-928d-470a-845a-bc7f863a266f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:35 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:35 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-af534a17-e52b-4641-988b-b3ef3ef748fb req-77679b67-ae0b-4fb1-b6a1-d532a74f1904 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-af534a17-e52b-4641-988b-b3ef3ef748fb req-77679b67-ae0b-4fb1-b6a1-d532a74f1904 tempest-TestStampPattern-1356011074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-af534a17-e52b-4641-988b-b3ef3ef748fb req-77679b67-ae0b-4fb1-b6a1-d532a74f1904 tempest-TestStampPattern-1356011074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-af534a17-e52b-4641-988b-b3ef3ef748fb req-77679b67-ae0b-4fb1-b6a1-d532a74f1904 tempest-TestStampPattern-1356011074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-22b5ca46-5ecd-4fe2-ad2b-884167899282', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2745db34-b0bf-4067-8b10-bb9003ea2376', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:33:36 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.285s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:36 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Deleted volume successfully. Aug 04 12:33:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-af534a17-e52b-4641-988b-b3ef3ef748fb req-77679b67-ae0b-4fb1-b6a1-d532a74f1904 tempest-TestStampPattern-1356011074 None] attachment_update completed successfully. Aug 04 12:33:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-96ddac56-0ed8-472d-8d95-c40f473ba765 tempest-VolumesCloneTest-1610345282 None] Lock "cinder-1fd53748-9fd4-4049-bc5a-7c201880144b-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-8fca84a9-21ac-4bca-bac5-3dffeb2febe0 req-f41ceeab-ea6b-43b9-b2b2-5df20ae60c6b tempest-TestStampPattern-1356011074 None] Terminate volume connection completed successfully. Aug 04 12:33:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-8fca84a9-21ac-4bca-bac5-3dffeb2febe0 req-f41ceeab-ea6b-43b9-b2b2-5df20ae60c6b tempest-TestStampPattern-1356011074 None] Deleting attachment 2745db34-b0bf-4067-8b10-bb9003ea2376. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Flow 'volume_create_manager' (41670fdb-c23a-49fc-8f66-5397367695bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c68dd66-645d-4a60-a0b9-e6e8b2719dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c68dd66-645d-4a60-a0b9-e6e8b2719dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-582366793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ea27a-64d8-4bb1-9988-9a9ddc312338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d9783fbc254217aa0b2568ffe925b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:40Z,use_quota=True,user_id='317494123f6847c9a11da32d0bb3aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3698a4da-b139-4646-8e9a-b4457d37e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3698a4da-b139-4646-8e9a-b4457d37e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fc28f8-7fb1-4da3-944b-052f5184b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fc28f8-7fb1-4da3-944b-052f5184b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96ea27a-64d8-4bb1-9988-9a9ddc312338', 'volume_name': 'volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b3f0f0-f3c0-4067-b930-1523412cd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b3f0f0-f3c0-4067-b930-1523412cd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1056deb-a83b-4e6d-a247-933b52184686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:40 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Volume f96ea27a-64d8-4bb1-9988-9a9ddc312338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338', 'volume_size': 1} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-582366793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96ea27a-64d8-4bb1-9988-9a9ddc312338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d9783fbc254217aa0b2568ffe925b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:40Z,use_quota=True,user_id='317494123f6847c9a11da32d0bb3aae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Creating volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:40 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:40 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 1073741824 Aug 04 12:33:40 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:41 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 1073741824" returned: 0 in 0.570s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:41 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 Aug 04 12:33:41 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:41 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338" returned: 0 in 0.381s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1056deb-a83b-4e6d-a247-933b52184686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc09a84-4db3-4a20-b1df-5a51d4ff115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Volume volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 (f96ea27a-64d8-4bb1-9988-9a9ddc312338): created successfully Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc09a84-4db3-4a20-b1df-5a51d4ff115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Flow 'volume_create_manager' (41670fdb-c23a-49fc-8f66-5397367695bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5e5f79a6-c148-4d46-bf64-467dce4dc7e3 tempest-VolumesSnapshotListTestJSON-2076099883 None] Created volume successfully. Aug 04 12:33:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Creating offline snapshot 428bf645-6e97-425a-828a-d907c44cf587 of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:33:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[712736ef-e98a-4524-a59f-94a6d3686c96]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:43 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 Aug 04 12:33:43 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:43 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338" returned: 0 in 0.456s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:43 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 1G Aug 04 12:33:43 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:44 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 1G" returned: 0 in 0.624s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:44 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:33:44 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:44 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.413s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:44 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 is being set with open permissions: ugo+rw Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:44 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:33:44 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:44 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.296s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:44 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info Aug 04 12:33:44 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:45 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info" returned: 0 in 0.314s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:45 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info is being set with open permissions: ugo+rw Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:45 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info Aug 04 12:33:45 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-22b5ca46-5ecd-4fe2-ad2b-884167899282-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "cinder-22b5ca46-5ecd-4fe2-ad2b-884167899282-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Flow 'volume_create_manager' (3c57c308-22bb-4351-9684-9e9c28e5402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc71dc4-d5ac-4369-b5ab-5caece8e8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" acquired by "delete_volume" :: waited 0.073s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc71dc4-d5ac-4369-b5ab-5caece8e8738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961966749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543d3fd3e9c4a9787a20f5785e7fe62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:45Z,use_quota=True,user_id='1dbd41ae4c9d447ea81e7a3b69cce901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dc43cf-673a-4a20-a479-94260ff00f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dc43cf-673a-4a20-a479-94260ff00f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb71146-d7ef-403a-af2e-b0fbabc98c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb71146-d7ef-403a-af2e-b0fbabc98c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd', 'volume_name': 'volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a94a968-fc53-4461-9b61-6d5e4d800ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a94a968-fc53-4461-9b61-6d5e4d800ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ef180a-5092-492f-92f2-ffc5e86da477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Volume dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd', 'volume_size': 1} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6877b264-0c11-4668-8bf6-86e729415410]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:45 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.info" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961966749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543d3fd3e9c4a9787a20f5785e7fe62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:45Z,use_quota=True,user_id='1dbd41ae4c9d447ea81e7a3b69cce901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Creating volume dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:45 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 Aug 04 12:33:45 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:45 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd 1073741824 Aug 04 12:33:45 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3428bb0e-7821-48aa-a8ab-cb9949694fee tempest-VolumesSnapshotListTestJSON-2076099883 None] Create snapshot completed successfully Aug 04 12:33:45 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282" returned: 0 in 0.441s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:45 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282 Aug 04 12:33:45 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:46 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd 1073741824" returned: 0 in 0.663s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:46 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-22b5ca46-5ecd-4fe2-ad2b-884167899282" returned: 0 in 0.421s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:46 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd Aug 04 12:33:46 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-22b5ca46-5ecd-4fe2-ad2b-884167899282" released by "delete_volume" :: held 0.976s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Created reservations ['56429c4f-d15b-49d9-ae65-6570408fd848', 'f361eed0-3711-4923-848f-1f36f34bd02b', '93e2e76a-ce02-465e-8418-fda6410a4938', '747470b8-57c6-41fb-9863-49dc16f4c2da'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:46 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:46 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:46 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" returned: 0 in 0.346s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.134s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Creating offline snapshot e7e67697-98ce-479a-8373-8f166a688ffb of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ef180a-5092-492f-92f2-ffc5e86da477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcaa9b3-d6d2-4da7-971e-376bc5f294d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b2555a-10aa-421d-9008-276b483a10e8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Volume volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd (dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd): created successfully Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcaa9b3-d6d2-4da7-971e-376bc5f294d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Flow 'volume_create_manager' (3c57c308-22bb-4351-9684-9e9c28e5402d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6e344a18-5886-4d46-b17e-a137a291393a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Created volume successfully. Aug 04 12:33:46 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Deleted volume successfully. Aug 04 12:33:46 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:33:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61ed9a14-14dd-4156-95cc-fca203d42399 tempest-TestStampPattern-1356011074 None] Lock "cinder-22b5ca46-5ecd-4fe2-ad2b-884167899282-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:46 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:47 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.444s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:47 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb 1G Aug 04 12:33:47 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:47 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb 1G" returned: 0 in 0.617s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:47 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:47 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Deleting offline snapshot 79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 of volume 8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] snapshot_file for this snap is: volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d6b25-0370-4f32-a5be-c26ccbf750ae]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:48 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:48 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb is being set with open permissions: ugo+rw Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:48 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:33:48 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:48 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:48 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:48 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:48 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.558s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-aebec332-e01d-4451-8b85-7c8f0e3382df tempest-VolumesSnapshotListTestJSON-2076099883 None] Create snapshot completed successfully Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981c994-0256-4096-9887-84d9d1a0031f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:48 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:33:48 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-66dd92de-b6cd-4540-a7d8-cd1833d5df4d req-3457835e-8f41-40ed-a795-f3ec8906ab6a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-66dd92de-b6cd-4540-a7d8-cd1833d5df4d req-3457835e-8f41-40ed-a795-f3ec8906ab6a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-66dd92de-b6cd-4540-a7d8-cd1833d5df4d req-3457835e-8f41-40ed-a795-f3ec8906ab6a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-66dd92de-b6cd-4540-a7d8-cd1833d5df4d req-3457835e-8f41-40ed-a795-f3ec8906ab6a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43d62bd9-8203-4d47-a563-9fda5b6b7778', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:33:49 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-66dd92de-b6cd-4540-a7d8-cd1833d5df4d req-3457835e-8f41-40ed-a795-f3ec8906ab6a tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] attachment_update completed successfully. Aug 04 12:33:49 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.580s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:49 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:33:49 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:49 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.476s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:49 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8 Aug 04 12:33:49 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Creating offline snapshot d0d83a33-1e8d-4b80-aee9-79d860f8a9ed of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[01734835-bf81-4296-84ec-4f0e6b4cab7a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:50 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76.79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" returned: 0 in 0.375s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:50 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:50 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8" released by "_delete_snapshot" :: held 2.170s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" released by "delete_snapshot" :: held 2.205s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Created reservations ['d9c34a6e-f445-4d14-b5c3-008dab21bc00', '2f4508da-9889-4cb6-a674-93252a650c73', 'a6445c8d-8dbc-4c52-898d-42ca54d9e22e', 'a9ee0cd3-5b62-4243-99f5-fc5dfda7a882'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Delete snapshot completed successfully. Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-867dc91f-49d2-4944-a9e7-3585b73edcc3 tempest-TestStampPattern-1356011074 None] Lock "cinder-79d35f2c-5d37-4c75-a5de-eb70a21fbcb8-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:50 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.528s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:50 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed 1G Aug 04 12:33:50 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (204927b6-3324-41bc-a5c7-b838b046c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56625a7d-1b90-4f43-8829-c57223abc556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56625a7d-1b90-4f43-8829-c57223abc556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125723786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb4545a-20c0-4543-9bd7-be5b0e10e181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:51Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd4d71d-3f6e-4937-a737-5105101ca3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd4d71d-3f6e-4937-a737-5105101ca3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75643aab-6d56-44de-92ad-0772f713c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75643aab-6d56-44de-92ad-0772f713c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb4545a-20c0-4543-9bd7-be5b0e10e181', 'volume_name': 'volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27323dd-68a6-4240-8ca3-1915899a0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27323dd-68a6-4240-8ca3-1915899a0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030b440-ac11-4dea-9d47-6f918cadbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume 8cb4545a-20c0-4543-9bd7-be5b0e10e181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181', 'volume_size': 1} Aug 04 12:33:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:51 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed 1G" returned: 0 in 0.481s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:51 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed Aug 04 12:33:51 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:51 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" returned: 0 in 0.324s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:51 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed is being set with open permissions: ugo+rw Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:51 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed Aug 04 12:33:51 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:51 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.727s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125723786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb4545a-20c0-4543-9bd7-be5b0e10e181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:51Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume 8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:51 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:51 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 1073741824 Aug 04 12:33:51 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-064afd52-705e-411c-96c6-f3f5a72568e1 tempest-VolumesSnapshotListTestJSON-2076099883 None] Create snapshot completed successfully Aug 04 12:33:52 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 1073741824" returned: 0 in 0.700s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 Aug 04 12:33:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:52 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181" returned: 0 in 0.509s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:33:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f030b440-ac11-4dea-9d47-6f918cadbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec039e09-78e0-4208-8712-0da7c9af2925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 (8cb4545a-20c0-4543-9bd7-be5b0e10e181): created successfully Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec039e09-78e0-4208-8712-0da7c9af2925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (204927b6-3324-41bc-a5c7-b838b046c318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ae76c027-41ff-4b04-b5a1-4213ef5f0047 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:33:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-72e1306f-cb61-4da6-acda-3276b6c801b7 req-21b6393b-5ceb-4bfe-b9bd-c5a59c3fc49c tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Terminate volume connection completed successfully. Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-72e1306f-cb61-4da6-acda-3276b6c801b7 req-21b6393b-5ceb-4bfe-b9bd-c5a59c3fc49c tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Deleting attachment 43d62bd9-8203-4d47-a563-9fda5b6b7778. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Deleting offline snapshot d0d83a33-1e8d-4b80-aee9-79d860f8a9ed of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] snapshot_file for this snap is: volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2001ce44-b5dc-47fa-aba8-04372535017b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:53 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed Aug 04 12:33:53 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:54 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" returned: 0 in 0.423s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab47f13-1efe-4f97-924b-ab45d3d9b652]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:54 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:54 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating offline snapshot b93d38b3-a8aa-4b0a-8f28-30d436348063 of volume 8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[713418bd-764c-47d2-81d8-ecab413c513b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:54 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 Aug 04 12:33:54 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:54 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.538s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:54 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed Aug 04 12:33:54 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "cinder-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "cinder-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "cinder-quobyte-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181" returned: 0 in 0.543s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "cinder-quobyte-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" acquired by "delete_volume" :: waited 0.053s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:55 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 1G Aug 04 12:33:55 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fe33e0-87ab-4881-b999-54f97ca856d1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd Aug 04 12:33:55 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" returned: 0 in 0.598s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed Aug 04 12:33:55 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" returned: 0 in 0.477s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd Aug 04 12:33:55 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 1G" returned: 0 in 0.603s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" returned: 0 in 0.386s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:55 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 Aug 04 12:33:55 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed" released by "_delete_snapshot" :: held 2.172s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" released by "delete_snapshot" :: held 2.221s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "cinder-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Acquiring lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc08e9c-ddbe-4a7a-879d-30101888581e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Created reservations ['1e4c6ea8-63f4-4964-a3e5-d9028deb74ae', '623beda2-4877-4bf9-955f-e625acdf469d', '0c0c7c46-afd3-4bfd-b962-74ac0fd2f94c', '1edd34c2-9c82-4037-9979-fb9548cd2d83'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:55 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "cinder-quobyte-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd" released by "delete_volume" :: held 0.865s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Delete snapshot completed successfully. Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ee629fd-6667-41fc-bcab-31a43dfa5877 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-d0d83a33-1e8d-4b80-aee9-79d860f8a9ed-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:55 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:33:55 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Created reservations ['89e15eb3-e177-4384-a140-5a78b7d59b18', '323662fd-6bfa-4165-b687-60341a801654', '2d479716-b246-42c9-89aa-f317751942db', '82fe5f4a-1efc-4737-8994-8c2787961d31'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:56 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063" returned: 0 in 0.455s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:56 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 is being set with open permissions: ugo+rw Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:56 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:56 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:56 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 Aug 04 12:33:56 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:56 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.476s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:56 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76 Aug 04 12:33:56 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:56 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.336s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Deleted volume successfully. Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a0c56cd-2b6c-4c7e-80b2-1405d2dd491b tempest-TestServerVolumeAttachScenarioOldVersion-1335382015 None] Lock "cinder-dd8ad706-f4ba-45ad-b6cc-54943cf8d2cd-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:56 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:56 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info Aug 04 12:33:56 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:56 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" returned: 0 in 0.421s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "cinder-quobyte-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76" released by "delete_volume" :: held 0.975s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-e7e67697-98ce-479a-8373-8f166a688ffb-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-e7e67697-98ce-479a-8373-8f166a688ffb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:56 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Created reservations ['616951ed-76ba-4284-bb93-4c5080c0ecab', '0c5814dd-948a-4183-a675-cb19b074b792', 'c95b2cf1-1e13-4efb-986f-874961388a9c', 'd48c9430-7d1e-432c-a33e-297a78027d95'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-e7e67697-98ce-479a-8373-8f166a688ffb" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:33:57 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-e7e67697-98ce-479a-8373-8f166a688ffb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Deleting offline snapshot e7e67697-98ce-479a-8373-8f166a688ffb of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] snapshot_file for this snap is: volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info" returned: 0 in 0.585s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:57 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info is being set with open permissions: ugo+rw Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6d921-d618-4b06-b137-b50bcb369dab]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:57 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info Aug 04 12:33:57 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:57 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:33:57 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:57 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:57 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:57 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.info" returned: 0 in 0.398s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-eddd514b-6947-44f8-93ca-5dfa248c2ade tempest-CreateVolumesFromSnapshotTest-844428353 None] Create snapshot completed successfully Aug 04 12:33:57 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:57 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.489s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.437s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:33:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Deleted volume successfully. Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f8546-0a44-46d6-a252-320cd93c03d4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-019f5ae8-1122-4637-89dd-be4fbbb979f2 tempest-TestStampPattern-1356011074 None] Lock "cinder-8cca8bf5-8a6d-4e9e-bd2f-2ac671b1ba76-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:57 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:33:57 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:58 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:33:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:58 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:58 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:58 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.674s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:58 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb Aug 04 12:33:58 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:59 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.e7e67697-98ce-479a-8373-8f166a688ffb" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-e7e67697-98ce-479a-8373-8f166a688ffb" released by "_delete_snapshot" :: held 2.166s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" released by "delete_snapshot" :: held 2.208s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Created reservations ['d02750fe-f873-4d42-9f5c-4d8d4ec7e44b', 'cfb6fbb5-1cd8-46a4-81d9-12d493eddb38', '93a887ad-395c-407d-b44b-a9e37e9f5ea4', 'f3db7d63-dfec-4323-b39f-f184a33f026d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (2bd93368-d9d2-4b52-bbcf-40aa62541674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5864875a-6fa8-4b13-a693-b302e08e3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5864875a-6fa8-4b13-a693-b302e08e3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085367124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf977e7c-0106-4942-982e-2307c1c2be6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:59Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4482eb0-4660-4cbb-a3df-278346ee1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4482eb0-4660-4cbb-a3df-278346ee1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece6caa6-b517-48e7-aa37-d51b3a586537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece6caa6-b517-48e7-aa37-d51b3a586537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf977e7c-0106-4942-982e-2307c1c2be6c', 'volume_name': 'volume-cf977e7c-0106-4942-982e-2307c1c2be6c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d49010e-1d9a-4ac7-a47d-41aba5831365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d49010e-1d9a-4ac7-a47d-41aba5831365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3676e21-55c9-4ae7-a7c6-dd16966427a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume cf977e7c-0106-4942-982e-2307c1c2be6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf977e7c-0106-4942-982e-2307c1c2be6c', 'volume_size': 1} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085367124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf977e7c-0106-4942-982e-2307c1c2be6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:33:59Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume cf977e7c-0106-4942-982e-2307c1c2be6c {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:33:59 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:33:59 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c 1073741824 Aug 04 12:33:59 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:33:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Delete snapshot completed successfully. Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eefd8579-87b2-465a-abda-59b7567ac744 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-e7e67697-98ce-479a-8373-8f166a688ffb-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (57351771-76b7-447b-97e2-10b03aefbfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a7a607-2418-4b73-93a2-780cba9d9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a7a607-2418-4b73-93a2-780cba9d9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783230671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:00Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763efb21-0f68-4a11-8256-862d42860045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763efb21-0f68-4a11-8256-862d42860045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f01b529-7775-4f4d-976f-619e99aa51c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f01b529-7775-4f4d-976f-619e99aa51c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e', 'volume_name': 'volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d454e-a628-4397-ba07-584350902656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:33:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d454e-a628-4397-ba07-584350902656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a301400-9834-4a69-a9d9-8c11f7bf8752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e', 'volume_size': 1} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-428bf645-6e97-425a-828a-d907c44cf587-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-428bf645-6e97-425a-828a-d907c44cf587-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-428bf645-6e97-425a-828a-d907c44cf587" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-428bf645-6e97-425a-828a-d907c44cf587" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Deleting offline snapshot 428bf645-6e97-425a-828a-d907c44cf587 of volume f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] snapshot_file for this snap is: volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:34:00 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d25e98-a29b-4229-94ea-8ef67bfeb54e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c 1073741824" returned: 0 in 0.711s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:00 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c Aug 04 12:34:00 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:00 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:34:00 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (221c5543-3331-4282-8605-0f0eb50482eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1faccf0-1743-4806-9fd8-23ec8ffbdd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1faccf0-1743-4806-9fd8-23ec8ffbdd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801262215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9053ea1-fab7-4e5d-8b05-2e6102d8accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:00Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee745a6-bd52-49c2-9413-f30b1992e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee745a6-bd52-49c2-9413-f30b1992e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9518ef87-1069-4ce7-967d-20677951daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9518ef87-1069-4ce7-967d-20677951daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9053ea1-fab7-4e5d-8b05-2e6102d8accd', 'volume_name': 'volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5c662e-fcd7-44cc-9963-4a08ed49fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5c662e-fcd7-44cc-9963-4a08ed49fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2287d3c-a5d8-48d1-8f35-bb718b9391c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume a9053ea1-fab7-4e5d-8b05-2e6102d8accd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd', 'volume_size': 1} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:00 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c" returned: 0 in 0.468s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783230671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:00Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:00 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:00 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e 1073741824 Aug 04 12:34:00 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:00 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3676e21-55c9-4ae7-a7c6-dd16966427a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf977e7c-0106-4942-982e-2307c1c2be6c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d28f0fb-eb36-4cc5-a477-73d7add3b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.697s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:34:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-cf977e7c-0106-4942-982e-2307c1c2be6c (cf977e7c-0106-4942-982e-2307c1c2be6c): created successfully Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d28f0fb-eb36-4cc5-a477-73d7add3b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (2bd93368-d9d2-4b52-bbcf-40aa62541674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531f9c6-b83c-40e1-abdd-e02ad60ba8c5]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-42c34c63-2513-4562-88a7-a23e01176a43 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (6e0c5e4d-c20e-4745-bf1f-2e41d6d6cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9877ec35-03f0-401c-81e5-b82e7cdd79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9877ec35-03f0-401c-81e5-b82e7cdd79ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253547009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cda7f79-7bd9-4ad7-bed7-8af5f7909089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:01Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d204b-983d-439e-b791-8aba499148c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d204b-983d-439e-b791-8aba499148c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0845678c-e1e8-40da-b411-45749f264895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0845678c-e1e8-40da-b411-45749f264895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cda7f79-7bd9-4ad7-bed7-8af5f7909089', 'volume_name': 'volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7622248c-bdcf-48ac-9332-05856c24719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7622248c-bdcf-48ac-9332-05856c24719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810348e3-4069-4c71-a7db-c71e853d9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume 3cda7f79-7bd9-4ad7-bed7-8af5f7909089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089', 'volume_size': 1} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:01 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 Aug 04 12:34:01 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:01 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e 1073741824" returned: 0 in 0.831s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (cf9ad6c7-edb0-454e-99c3-a25ec343207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:01 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a567efc6-0020-4d50-ad50-943c6a6d85bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338" returned: 0 in 0.806s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:01 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:34:01 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a567efc6-0020-4d50-ad50-943c6a6d85bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467944033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263ff52-16b2-46b8-b5a4-f4a3045de5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:02Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95cb260-3757-4332-9140-bf800eb9b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95cb260-3757-4332-9140-bf800eb9b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c11588c-e647-4315-88b5-9a70dd569c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e Aug 04 12:34:01 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c11588c-e647-4315-88b5-9a70dd569c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1263ff52-16b2-46b8-b5a4-f4a3045de5f0', 'volume_name': 'volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c73df7-6d48-4836-8733-a0574c3c256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c73df7-6d48-4836-8733-a0574c3c256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb826b6-d2f5-41c9-bac7-a607f152bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume 1263ff52-16b2-46b8-b5a4-f4a3045de5f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0', 'volume_size': 1} Aug 04 12:34:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:02 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" returned: 0 in 0.354s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801262215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9053ea1-fab7-4e5d-8b05-2e6102d8accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:00Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume a9053ea1-fab7-4e5d-8b05-2e6102d8accd {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:02 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a301400-9834-4a69-a9d9-8c11f7bf8752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8aacd-0369-40bc-b3ec-a053ad2e3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:02 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd 1073741824 Aug 04 12:34:02 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:02 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e (bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e): created successfully Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8aacd-0369-40bc-b3ec-a053ad2e3804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (57351771-76b7-447b-97e2-10b03aefbfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bdd43bc5-8aee-42a9-a4b3-74829c17bfc6 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:34:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.504s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:02 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587 Aug 04 12:34:02 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:02 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338.428bf645-6e97-425a-828a-d907c44cf587" returned: 0 in 0.304s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-428bf645-6e97-425a-828a-d907c44cf587" released by "_delete_snapshot" :: held 2.535s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" released by "delete_snapshot" :: held 2.580s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:02 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd 1073741824" returned: 0 in 0.520s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:02 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd Aug 04 12:34:02 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:02 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Created reservations ['12b274a3-66ff-43b6-a692-587e8d753fa2', '90ecff4a-df3f-4363-bc51-f15ed5816ced', '878db1b7-f971-4c74-af1e-ec77d5831d47', 'b5faa3d6-cd3a-40f8-a55a-8fbb42240876'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Delete snapshot completed successfully. Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db501fa3-23c8-45d3-b455-f54c7629fa85 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-428bf645-6e97-425a-828a-d907c44cf587-delete_snapshot" released by "delete_snapshot" :: held 2.916s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:03 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253547009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cda7f79-7bd9-4ad7-bed7-8af5f7909089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:01Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume 3cda7f79-7bd9-4ad7-bed7-8af5f7909089 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:03 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2287d3c-a5d8-48d1-8f35-bb718b9391c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:03 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 1073741824 Aug 04 12:34:03 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def077df-0fbe-4848-8253-51c9d1f866c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:03 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd (a9053ea1-fab7-4e5d-8b05-2e6102d8accd): created successfully Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def077df-0fbe-4848-8253-51c9d1f866c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (221c5543-3331-4282-8605-0f0eb50482eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a2cd79fe-02dc-4118-8519-d55158c2b418 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-f96ea27a-64d8-4bb1-9988-9a9ddc312338-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-f96ea27a-64d8-4bb1-9988-9a9ddc312338-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72dc8d3-b8f4-43ee-b24b-648ac04d2502]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:03 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 Aug 04 12:34:03 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:04 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 1073741824" returned: 0 in 0.790s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:04 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 Aug 04 12:34:04 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:04 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338" returned: 0 in 0.544s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:04 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338 Aug 04 12:34:04 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:04 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" returned: 0 in 0.333s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467944033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263ff52-16b2-46b8-b5a4-f4a3045de5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89e1b5ed5943c3b589fc3a45f7c453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:02Z,use_quota=True,user_id='02bab0400bf844a0b584e40709623ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Creating volume 1263ff52-16b2-46b8-b5a4-f4a3045de5f0 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:04 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810348e3-4069-4c71-a7db-c71e853d9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e896412-fbed-4ece-9d84-3132f857e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:04 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 1073741824 Aug 04 12:34:04 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 (3cda7f79-7bd9-4ad7-bed7-8af5f7909089): created successfully Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e896412-fbed-4ece-9d84-3132f857e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (6e0c5e4d-c20e-4745-bf1f-2e41d6d6cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3e61bcff-89e7-435c-badb-b7926f17f804 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:34:04 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f96ea27a-64d8-4bb1-9988-9a9ddc312338" returned: 0 in 0.333s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-quobyte-f96ea27a-64d8-4bb1-9988-9a9ddc312338" released by "delete_volume" :: held 0.952s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Created reservations ['8e326550-0b36-49fa-8110-e8edef31b9a1', 'da3cbb80-3a07-4976-a9ca-b3a3bcb5d7d8', '7da64b5a-c70b-4b8d-8d84-b85f6782ef02', 'ecafab73-93aa-4f65-99a5-ef0de0c5d5ca'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:04 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:04 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:05 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 1073741824" returned: 0 in 0.671s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:05 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.329s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Deleted volume successfully. Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1fd3bedd-bfe9-4441-872c-8718ef629821 tempest-VolumesSnapshotListTestJSON-2076099883 None] Lock "cinder-f96ea27a-64d8-4bb1-9988-9a9ddc312338-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:05 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 Aug 04 12:34:05 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:05 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" returned: 0 in 0.345s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb826b6-d2f5-41c9-bac7-a607f152bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa8dcf-4415-495d-a03f-a5cb08fae9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Volume volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 (1263ff52-16b2-46b8-b5a4-f4a3045de5f0): created successfully Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa8dcf-4415-495d-a03f-a5cb08fae9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Flow 'volume_create_manager' (cf9ad6c7-edb0-454e-99c3-a25ec343207c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e6cd5b9a-a7b0-4ef3-b0c2-6bee33691d64 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created volume successfully. Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:06 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:06 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-1263ff52-16b2-46b8-b5a4-f4a3045de5f0-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-1263ff52-16b2-46b8-b5a4-f4a3045de5f0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:06 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.459s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f838d7cc-6e1a-4223-8d4c-342321ccd26c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:34:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:34:06 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 Aug 04 12:34:06 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:07 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" returned: 0 in 0.422s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:07 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0 Aug 04 12:34:07 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:07 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" returned: 0 in 0.282s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-1263ff52-16b2-46b8-b5a4-f4a3045de5f0" released by "delete_volume" :: held 0.783s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['49196098-79c9-40db-9dc3-a947f7585b12', '1d511e10-4b70-4733-8d75-445ad8d0c3db', '9bcc12bb-27ac-460b-baf8-33f1d55150a2', '4dcc0dc1-5195-4b60-9b08-be5d7ed438b4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:07 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:07 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-3cda7f79-7bd9-4ad7-bed7-8af5f7909089-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-3cda7f79-7bd9-4ad7-bed7-8af5f7909089-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec5f37d-56f8-496f-a6ea-cea8d6b1228e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:07 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:07 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0add7724-57d4-4431-99a4-c36511cd9060 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-1263ff52-16b2-46b8-b5a4-f4a3045de5f0-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:08 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 Aug 04 12:34:08 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:08 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" returned: 0 in 0.555s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:08 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089 Aug 04 12:34:08 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:08 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" returned: 0 in 0.323s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-3cda7f79-7bd9-4ad7-bed7-8af5f7909089" released by "delete_volume" :: held 0.932s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['d6844e9e-81fd-4794-a9d0-53ae98df5c7b', '9c9e2214-8933-4d8d-865c-579ae4750496', 'c398c911-3e09-4d67-9565-253240d585d7', '0039d2ba-527e-4b7b-bc02-5b585ca37b8d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:09 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:09 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:09 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c009f781-1fe9-499c-9095-1c4921ff7d85 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-3cda7f79-7bd9-4ad7-bed7-8af5f7909089-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-a9053ea1-fab7-4e5d-8b05-2e6102d8accd-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-a9053ea1-fab7-4e5d-8b05-2e6102d8accd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" acquired by "delete_volume" :: waited 0.046s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9752d954-402d-483b-8a85-51b5fad10e3a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:10 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd Aug 04 12:34:10 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:10 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" returned: 0 in 0.572s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:11 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd Aug 04 12:34:11 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:11 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" returned: 0 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-a9053ea1-fab7-4e5d-8b05-2e6102d8accd" released by "delete_volume" :: held 1.021s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['6e82e208-2fb9-4367-a39a-cbe6a0a9241c', '08dc1555-6dbc-475b-9d7a-145c41ad5257', '3e48f64b-f398-4e36-95b8-7d7a7d9f5fd2', 'e574d99a-0699-4bd0-83f7-1610e453fcc7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:11 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:11 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:11 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.307s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a33835e0-1c28-4f58-ba9f-6bbb3f164f48 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-a9053ea1-fab7-4e5d-8b05-2e6102d8accd-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[029b862a-6c78-441c-9ce6-f40b2a5b6c87]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:12 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e Aug 04 12:34:12 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:13 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:13 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e Aug 04 12:34:13 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:13 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e" released by "delete_volume" :: held 0.803s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['b2b0df49-98af-46cd-b83b-ea525f9d378f', 'd1737845-7b10-41ec-b3c1-a22c1c7146c7', 'dc8acbf8-145e-4ab8-aef4-c9ffaf7ccb77', '807b22ac-c30d-4229-9a17-952b8d9e35e5'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:13 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:13 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-cf977e7c-0106-4942-982e-2307c1c2be6c-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-cf977e7c-0106-4942-982e-2307c1c2be6c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-cf977e7c-0106-4942-982e-2307c1c2be6c" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-cf977e7c-0106-4942-982e-2307c1c2be6c" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ca9fd7-1a72-4f7f-95db-ec405b329fb9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:14 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:14 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-68d1a470-5499-4aaf-83a8-ef047e128a1f tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-bc1e88b2-dcd2-4a9d-bfc3-e1fe8c461c7e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:14 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c Aug 04 12:34:14 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c" returned: 0 in 0.505s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:14 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c Aug 04 12:34:14 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:14 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cf977e7c-0106-4942-982e-2307c1c2be6c" returned: 0 in 0.345s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-cf977e7c-0106-4942-982e-2307c1c2be6c" released by "delete_volume" :: held 0.915s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (a64849bf-6c27-451f-8a5e-d233516f9ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685a5bb2-406e-4aec-a715-365d6e7e3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['13118cce-f690-4cd2-9e46-c0f329554549', '26cbebf5-b940-4430-ab88-e74dddbe8b98', 'de4d7d7c-382c-4e28-bd6e-42e65af40d08', '79216435-3b69-4e07-a9be-7ca692d1f060'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:14 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685a5bb2-406e-4aec-a715-365d6e7e3a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422255323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5e341d-9fb8-4ee4-a16a-512bc17fbd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:15Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fc9ada-c003-463c-a467-073a43e84961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fc9ada-c003-463c-a467-073a43e84961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d03b7aa-3d30-45ae-a978-33763433cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d03b7aa-3d30-45ae-a978-33763433cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5e341d-9fb8-4ee4-a16a-512bc17fbd49', 'volume_name': 'volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba86ce-4554-4bfa-a65e-9f2d2731c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba86ce-4554-4bfa-a65e-9f2d2731c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3896f49-13d6-4bcd-83d5-4181061c8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume 4e5e341d-9fb8-4ee4-a16a-512bc17fbd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49', 'volume_size': 1} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422255323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5e341d-9fb8-4ee4-a16a-512bc17fbd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:15Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume 4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:15 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 1073741824 Aug 04 12:34:15 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Flow 'volume_create_manager' (90fedf07-a44e-4ed7-8a55-2fe5f74d2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b8c95c-8266-47d0-90f7-915007b79337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b8c95c-8266-47d0-90f7-915007b79337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e06a0b-1bd4-4d03-a0e2-e1b562599cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34da36c2a88e4e11a9dd51cda0b0a70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:15Z,use_quota=True,user_id='c619b1487d1b432e8c4f9ed47e5b9895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d00375a-c4b4-4618-882c-9f7354444a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d00375a-c4b4-4618-882c-9f7354444a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39746e0-668c-42c3-9625-57ab9a2e3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:15 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:15 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:15 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.299s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-494dbb77-de97-4c8e-b2a6-d95d41d0f599 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-cf977e7c-0106-4942-982e-2307c1c2be6c-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:15 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 1073741824" returned: 0 in 0.569s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:15 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 Aug 04 12:34:15 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39746e0-668c-42c3-9625-57ab9a2e3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69e06a0b-1bd4-4d03-a0e2-e1b562599cc8', 'volume_name': 'volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8', 'volume_size': 1, 'image_id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc984080cab87390e25fee9a2d283f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34da36c2a88e4e11a9dd51cda0b0a70f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a01bbe6832410bcfa899ac1494667271d1e1d3bdf737d067ca6ec728536879b60117dea0c015aef9878f5b6dfe328cf6d4b4c0dc02537422a7c2551a71b12213', 'id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'created_at': datetime.datetime(2026, 8, 4, 10, 34, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5644b44-df90-4eef-8082-145d27040d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5644b44-df90-4eef-8082-145d27040d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07131c89-40b9-42c6-9c1f-a3ebc1d842e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8', 'volume_size': 1, 'image_id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc984080cab87390e25fee9a2d283f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34da36c2a88e4e11a9dd51cda0b0a70f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a01bbe6832410bcfa899ac1494667271d1e1d3bdf737d067ca6ec728536879b60117dea0c015aef9878f5b6dfe328cf6d4b4c0dc02537422a7c2551a71b12213', 'id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'created_at': datetime.datetime(2026, 8, 4, 10, 34, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb/file', 'properties': {}}, 'image_service': } Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Trying to clone 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 from image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:34:15 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" returned: 0 in 0.297s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3896f49-13d6-4bcd-83d5-4181061c8e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a26668-2e34-4c33-9652-f2e5eead6834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 (4e5e341d-9fb8-4ee4-a16a-512bc17fbd49): created successfully Aug 04 12:34:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a26668-2e34-4c33-9652-f2e5eead6834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (a64849bf-6c27-451f-8a5e-d233516f9ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7c5bdfe6-37e7-47f1-a6f0-289765cd42b4 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:34:16 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Image download 0.00 MB at 0.00 MB/s Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-b93d38b3-a8aa-4b0a-8f28-30d436348063-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd9c32-fe11-41ce-b40f-e7ff5c87880d]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-b93d38b3-a8aa-4b0a-8f28-30d436348063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-b93d38b3-a8aa-4b0a-8f28-30d436348063" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-b93d38b3-a8aa-4b0a-8f28-30d436348063" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleting offline snapshot b93d38b3-a8aa-4b0a-8f28-30d436348063 of volume 8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] snapshot_file for this snap is: volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6ca47f-759e-43a3-8f43-a1bbd43ecd70]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:16 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:16 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:16 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 Aug 04 12:34:16 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:16 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:16 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:16 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:16 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063" returned: 0 in 0.441s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff6fc4-e82e-42f2-bf97-344d59f3ccde]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:16 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 Aug 04 12:34:16 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:16 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Temporary image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb is fetched for user c619b1487d1b432e8c4f9ed47e5b9895. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17c65a-c099-443c-bb3f-9f7351c0fa3c]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:17 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:17 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:17 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181" returned: 0 in 0.586s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:17 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 Aug 04 12:34:17 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:17 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:17 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (f16c7c95-dc36-4fb1-a889-8ddbefe04734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa5d7c0-fd34-420b-9871-4569e5bfcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa5d7c0-fd34-420b-9871-4569e5bfcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950872911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109743cc-e228-40ca-a4d6-8a886c68e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:18Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02ea709-f071-4cfb-b461-91c410a90e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02ea709-f071-4cfb-b461-91c410a90e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:17 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307f8ab6-9552-4210-9db8-fc2b57b398ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307f8ab6-9552-4210-9db8-fc2b57b398ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109743cc-e228-40ca-a4d6-8a886c68e98f', 'volume_name': 'volume-109743cc-e228-40ca-a4d6-8a886c68e98f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e9f90a-d684-4ddd-9801-32045b2f2808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e9f90a-d684-4ddd-9801-32045b2f2808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4f8b85-376d-4396-86f4-d2217ff47263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume 109743cc-e228-40ca-a4d6-8a886c68e98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109743cc-e228-40ca-a4d6-8a886c68e98f', 'volume_size': 1} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950872911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109743cc-e228-40ca-a4d6-8a886c68e98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:18Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume 109743cc-e228-40ca-a4d6-8a886c68e98f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:17 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063" returned: 0 in 0.612s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:17 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f 1073741824 Aug 04 12:34:17 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:17 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063 Aug 04 12:34:17 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:18 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:18 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181.b93d38b3-a8aa-4b0a-8f28-30d436348063" returned: 0 in 0.326s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (a9f5a77a-a5b8-419a-af97-0abdcbe59d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae72197-a34d-4833-b7c7-4c1cc97c6b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-b93d38b3-a8aa-4b0a-8f28-30d436348063" released by "_delete_snapshot" :: held 2.194s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae72197-a34d-4833-b7c7-4c1cc97c6b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757789386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35e0973-ef5b-4539-a35c-877bd6e4d9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:18Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b2a47-ab07-4d4d-8a63-9b6d50d2bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b2a47-ab07-4d4d-8a63-9b6d50d2bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfa2d63-7689-4ef2-a76e-d01faac70fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfa2d63-7689-4ef2-a76e-d01faac70fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35e0973-ef5b-4539-a35c-877bd6e4d9f5', 'volume_name': 'volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a70b6c-4fe5-499c-9d18-84c242c36602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a70b6c-4fe5-499c-9d18-84c242c36602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3411b-3a0c-4a2a-8556-08bacdd7b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume b35e0973-ef5b-4539-a35c-877bd6e4d9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5', 'volume_size': 1} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" released by "delete_snapshot" :: held 2.281s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['950248db-f441-4a64-8707-efe2d802b9e9', '6357db9c-0a04-4e5a-8259-c97167d66d6d', '9afb71e7-d4da-4483-8809-fb330a4bd97e', '5bc032b1-7254-40b4-b062-1a3ed450d3c5'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:18 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f 1073741824" returned: 0 in 0.669s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Delete snapshot completed successfully. Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-819707e7-d8ed-4dc8-9e14-1b46ba425860 tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-b93d38b3-a8aa-4b0a-8f28-30d436348063-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:18 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f Aug 04 12:34:18 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (3d6786e4-2f4d-41b8-92b4-51549c694837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5515df-fd92-477f-baa2-de39dba38057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5515df-fd92-477f-baa2-de39dba38057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622038654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd906cc-5335-47a6-afdb-14aeefed22f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:19Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db7e9a-8273-4c9d-ba3f-b5c80185d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db7e9a-8273-4c9d-ba3f-b5c80185d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a25012-cf58-4e54-b771-3e775d290079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a25012-cf58-4e54-b771-3e775d290079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd906cc-5335-47a6-afdb-14aeefed22f5', 'volume_name': 'volume-8bd906cc-5335-47a6-afdb-14aeefed22f5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3af897d-ef1c-4024-b583-e3e87f027842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3af897d-ef1c-4024-b583-e3e87f027842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770b4ac-e2e3-4732-aa01-eabe7042b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:18 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume 8bd906cc-5335-47a6-afdb-14aeefed22f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd906cc-5335-47a6-afdb-14aeefed22f5', 'volume_size': 1} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:18 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e06a0b-1bd4-4d03-a0e2-e1b562599cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34da36c2a88e4e11a9dd51cda0b0a70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:15Z,use_quota=True,user_id='c619b1487d1b432e8c4f9ed47e5b9895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Creating volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:19 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:19 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1073741824 Aug 04 12:34:19 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4f8b85-376d-4396-86f4-d2217ff47263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109743cc-e228-40ca-a4d6-8a886c68e98f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f0a878-dcbe-49a6-a1a0-df33d941bc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-109743cc-e228-40ca-a4d6-8a886c68e98f (109743cc-e228-40ca-a4d6-8a886c68e98f): created successfully Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f0a878-dcbe-49a6-a1a0-df33d941bc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (f16c7c95-dc36-4fb1-a889-8ddbefe04734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2234d7d0-8635-4d7e-a7b0-c3b29d8ad37d tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (7318dc31-7a19-491e-b273-9251c1237f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5556236a-298c-4cec-b4c7-5d1a46bf0016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5556236a-298c-4cec-b4c7-5d1a46bf0016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298224261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91960461-d651-4f33-a344-b87edd38ca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:19Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d734e16-98cf-45f1-9b97-52cdc6ac7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d734e16-98cf-45f1-9b97-52cdc6ac7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e887d8-64e6-45b6-ab4c-ac180dcdd574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e887d8-64e6-45b6-ab4c-ac180dcdd574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91960461-d651-4f33-a344-b87edd38ca33', 'volume_name': 'volume-91960461-d651-4f33-a344-b87edd38ca33', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1037ffbd-2fe8-4ae7-b83f-6a1c8ac9f6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1037ffbd-2fe8-4ae7-b83f-6a1c8ac9f6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4814903-c854-4893-a177-0733dcf53aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume 91960461-d651-4f33-a344-b87edd38ca33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91960461-d651-4f33-a344-b87edd38ca33', 'volume_size': 1} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-8cb4545a-20c0-4543-9bd7-be5b0e10e181-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-8cb4545a-20c0-4543-9bd7-be5b0e10e181-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:19 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1073741824" returned: 0 in 0.705s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cccaad-b269-4334-96c3-4e7ad3ba838d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (77530f20-4fdb-4d06-a3b0-746dd0c577da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7165e59-ab32-49ba-9a2f-e75e7ec53157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7165e59-ab32-49ba-9a2f-e75e7ec53157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-578341184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0f22a2-b75f-4895-860d-50107af17fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:20Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d09cd0-5367-4090-973d-b6589373d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d09cd0-5367-4090-973d-b6589373d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a7222d-3326-4069-9b07-8068608a8340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a7222d-3326-4069-9b07-8068608a8340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0f22a2-b75f-4895-860d-50107af17fb5', 'volume_name': 'volume-3b0f22a2-b75f-4895-860d-50107af17fb5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60340d3-0f62-4757-9dab-f9a1138d128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60340d3-0f62-4757-9dab-f9a1138d128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:19 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 Aug 04 12:34:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f1b6d6-6dd1-4681-919b-8bb3b9e4132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:19 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume 3b0f22a2-b75f-4895-860d-50107af17fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0f22a2-b75f-4895-860d-50107af17fb5', 'volume_size': 1} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:19 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 Aug 04 12:34:19 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:20 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181" returned: 0 in 0.370s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" returned: 0 in 0.269s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757789386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35e0973-ef5b-4539-a35c-877bd6e4d9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:18Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume b35e0973-ef5b-4539-a35c-877bd6e4d9f5 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:20 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181 Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:20 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:20 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 1073741824 Aug 04 12:34:20 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Attempting download of 1a351af7-3461-47d9-a9e4-5c7cc957b4cb ((None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}])) to volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ee050-9679-457b-9f70-12af0397d477]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7 Aug 04 12:34:20 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:20 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8cb4545a-20c0-4543-9bd7-be5b0e10e181" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-quobyte-8cb4545a-20c0-4543-9bd7-be5b0e10e181" released by "delete_volume" :: held 0.827s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Created reservations ['f4654b3b-2ddb-4944-aa9f-390c041a9ce4', '479d191c-0c1e-43d9-a127-bd580cb552ae', '9bf51aeb-43c6-4cb9-b373-9076cbff387a', '96e17dbf-a310-41ed-a1c6-2d4d38823c21'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:20 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 1073741824" returned: 0 in 0.693s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:20 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:20 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7" returned: 0 in 0.574s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:20 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:20 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 Aug 04 12:34:20 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:21 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7 Aug 04 12:34:21 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:21 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.349s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Deleted volume successfully. Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a8e87e3-3947-44ee-85a9-b4a4301f404d tempest-CreateVolumesFromSnapshotTest-844428353 None] Lock "cinder-8cb4545a-20c0-4543-9bd7-be5b0e10e181-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:21 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" returned: 0 in 0.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622038654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd906cc-5335-47a6-afdb-14aeefed22f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:19Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume 8bd906cc-5335-47a6-afdb-14aeefed22f5 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:21 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3411b-3a0c-4a2a-8556-08bacdd7b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:21 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 1073741824 Aug 04 12:34:21 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91090169-25e0-495f-8021-cbf0a6e3e3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:21 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 (b35e0973-ef5b-4539-a35c-877bd6e4d9f5): created successfully Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91090169-25e0-495f-8021-cbf0a6e3e3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (a9f5a77a-a5b8-419a-af97-0abdcbe59d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:21 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7" returned: 1 in 0.592s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_1os6_cn7' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:34:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-79564273-4e29-4bd7-aeaa-fab92cb68ff5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b55ac0-2ac4-4ebe-854e-62f29672dcce]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:21 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:21 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:22 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 1073741824" returned: 0 in 0.835s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:22 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:22 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 Aug 04 12:34:22 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:22 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD Aug 04 12:34:22 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:22 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.260s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298224261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91960461-d651-4f33-a344-b87edd38ca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:19Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume 91960461-d651-4f33-a344-b87edd38ca33 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:22 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:22 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] 1a351af7-3461-47d9-a9e4-5c7cc957b4cb was raw, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:22 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 1073741824 Aug 04 12:34:22 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770b4ac-e2e3-4732-aa01-eabe7042b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd906cc-5335-47a6-afdb-14aeefed22f5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73477c61-3711-46dd-a3be-ce6b70092cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:22 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 Aug 04 12:34:22 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 (8bd906cc-5335-47a6-afdb-14aeefed22f5): created successfully Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73477c61-3711-46dd-a3be-ce6b70092cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (3d6786e4-2f4d-41b8-92b4-51549c694837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4f8ef1bd-9c17-4d28-b3f0-f7f32246160f tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:23 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 1073741824" returned: 0 in 0.613s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:23 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 Aug 04 12:34:23 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:23 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" returned: 0 in 0.815s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a351af7-3461-47d9-a9e4-5c7cc957b4cb_x1p9n_rjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:34:23 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Converted 0.00 MB image at 0.00 MB/s Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:23 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1G Aug 04 12:34:23 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:23 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33" returned: 0 in 0.346s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.765s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-578341184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0f22a2-b75f-4895-860d-50107af17fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8354514a45148b0afeeecba1bb5f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:20Z,use_quota=True,user_id='fff2834eeb584951830238b6fcf42442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Creating volume 3b0f22a2-b75f-4895-860d-50107af17fb5 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:23 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4814903-c854-4893-a177-0733dcf53aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91960461-d651-4f33-a344-b87edd38ca33', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:23 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 1073741824 Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271a4ab-b18f-45bb-9738-251b4b563fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:23 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-91960461-d651-4f33-a344-b87edd38ca33 (91960461-d651-4f33-a344-b87edd38ca33): created successfully Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a271a4ab-b18f-45bb-9738-251b4b563fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (7318dc31-7a19-491e-b273-9251c1237f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ca83fc64-a9ec-4d20-8d4a-d1574229dbc6 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:23 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 1G" returned: 0 in 0.510s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Downloaded image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb ((None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}])) to volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Temporary image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb for user c619b1487d1b432e8c4f9ed47e5b9895 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Marking volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Copying metadata from image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb to 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:34:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Creating volume glance metadata for volume 69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 backed by image 1a351af7-3461-47d9-a9e4-5c7cc957b4cb with: {'image_id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2fc984080cab87390e25fee9a2d283f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07131c89-40b9-42c6-9c1f-a3ebc1d842e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8', 'volume_size': 1, 'image_id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc984080cab87390e25fee9a2d283f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34da36c2a88e4e11a9dd51cda0b0a70f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a01bbe6832410bcfa899ac1494667271d1e1d3bdf737d067ca6ec728536879b60117dea0c015aef9878f5b6dfe328cf6d4b4c0dc02537422a7c2551a71b12213', 'id': '1a351af7-3461-47d9-a9e4-5c7cc957b4cb', 'created_at': datetime.datetime(2026, 8, 4, 10, 34, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a351af7-3461-47d9-a9e4-5c7cc957b4cb/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5254e93-ac0b-44d8-b770-f91e9d066031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Volume volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 (69e06a0b-1bd4-4d03-a0e2-e1b562599cc8): created successfully Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5254e93-ac0b-44d8-b770-f91e9d066031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Flow 'volume_create_manager' (90fedf07-a44e-4ed7-8a55-2fe5f74d2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:24 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0666a19c-45f4-4501-b5c4-31ebf0052a02 tempest-VolumeImageDependencyTests-1413127455 None] Created volume successfully. Aug 04 12:34:24 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 1073741824" returned: 0 in 0.820s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:24 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 Aug 04 12:34:24 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:24 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f1b6d6-6dd1-4681-919b-8bb3b9e4132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0f22a2-b75f-4895-860d-50107af17fb5', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac8203f-88f9-431e-87fe-002cdcc1ba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Volume volume-3b0f22a2-b75f-4895-860d-50107af17fb5 (3b0f22a2-b75f-4895-860d-50107af17fb5): created successfully Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac8203f-88f9-431e-87fe-002cdcc1ba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Flow 'volume_create_manager' (77530f20-4fdb-4d06-a3b0-746dd0c577da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:24 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2870a2a9-a053-47b5-9d8e-32f42c77c844 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created volume successfully. Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Acquiring lock "cinder-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "cinder-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Acquiring lock "cinder-quobyte-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "cinder-quobyte-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2397f02c-d595-4103-9dd4-8770696d5023]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:25 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 Aug 04 12:34:25 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-3b0f22a2-b75f-4895-860d-50107af17fb5-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-3b0f22a2-b75f-4895-860d-50107af17fb5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:25 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" returned: 0 in 0.482s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-3b0f22a2-b75f-4895-860d-50107af17fb5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:25 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8 Aug 04 12:34:25 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-3b0f22a2-b75f-4895-860d-50107af17fb5" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0095f5b1-6f77-4b8d-9974-767e2af17ef2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:25 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 Aug 04 12:34:25 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:26 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Flow 'volume_create_manager' (fc0d3a7f-f059-4175-ada2-11e340fb186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aad072-823c-4887-b2a4-dfa37e5db4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" returned: 0 in 0.450s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aad072-823c-4887-b2a4-dfa37e5db4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261840404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e600a7-1c94-4631-84f8-97b10d394038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cefb1ef30d3471cbf7be483015de923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:26Z,use_quota=True,user_id='6e22a0f8fc7a4aae8027d7b0cd38bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfaf3b8-662f-4aa8-b669-16fe7a4586bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfaf3b8-662f-4aa8-b669-16fe7a4586bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7efd435-2b67-42dd-b87b-c343756772fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7efd435-2b67-42dd-b87b-c343756772fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e600a7-1c94-4631-84f8-97b10d394038', 'volume_name': 'volume-09e600a7-1c94-4631-84f8-97b10d394038', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f776a86f-a9d6-4285-90f7-0563f8c30056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f776a86f-a9d6-4285-90f7-0563f8c30056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c4ea66-39ba-45b2-b767-f29c5cb3506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Volume 09e600a7-1c94-4631-84f8-97b10d394038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e600a7-1c94-4631-84f8-97b10d394038', 'volume_size': 1} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261840404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e600a7-1c94-4631-84f8-97b10d394038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cefb1ef30d3471cbf7be483015de923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:26Z,use_quota=True,user_id='6e22a0f8fc7a4aae8027d7b0cd38bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Creating volume 09e600a7-1c94-4631-84f8-97b10d394038 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:26 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "cinder-quobyte-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8" released by "delete_volume" :: held 1.081s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:26 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 1073741824 Aug 04 12:34:26 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Created reservations ['497e00a7-df08-4b4e-99d6-c7eb7ba13f03', 'f000dd1d-445a-4fc4-9672-95918f812238', '471be99f-5d88-4604-8b0f-d8b445e301d6', '42776474-3e60-4853-8628-c0402386acc7'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:26 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5" returned: 0 in 0.561s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:26 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5 Aug 04 12:34:26 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:26 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:26 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:26 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3b0f22a2-b75f-4895-860d-50107af17fb5" returned: 0 in 0.299s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-3b0f22a2-b75f-4895-860d-50107af17fb5" released by "delete_volume" :: held 0.924s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['f3b8cfc3-2e2d-4321-b87c-ab90d6a42774', 'de203f18-04d9-4fa9-a7d5-ec46fdf6d4ed', 'b3d51bf0-4bcb-43a6-b82a-9dc53004242e', '86afadd9-da14-461e-bafb-2b157b2b7989'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:26 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.328s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Deleted volume successfully. Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2bd55dc1-dc5c-4f3e-a480-77ad161e0c44 tempest-VolumeImageDependencyTests-1413127455 None] Lock "cinder-69e06a0b-1bd4-4d03-a0e2-e1b562599cc8-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:26 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 1073741824" returned: 0 in 0.604s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:26 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:26 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:26 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 Aug 04 12:34:26 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:27 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:27 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038" returned: 0 in 0.277s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c4ea66-39ba-45b2-b767-f29c5cb3506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e600a7-1c94-4631-84f8-97b10d394038', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13656f85-548f-4627-8b33-bad21610318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Volume volume-09e600a7-1c94-4631-84f8-97b10d394038 (09e600a7-1c94-4631-84f8-97b10d394038): created successfully Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13656f85-548f-4627-8b33-bad21610318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Flow 'volume_create_manager' (fc0d3a7f-f059-4175-ada2-11e340fb186c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-971bb500-72d6-425b-b011-63b5b172d3bf tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-3b0f22a2-b75f-4895-860d-50107af17fb5-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cf506dde-6d2c-4169-9fa9-371d2c4e3ca1 tempest-ProjectReaderTests-477630239 None] Created volume successfully. Aug 04 12:34:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-91960461-d651-4f33-a344-b87edd38ca33-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-91960461-d651-4f33-a344-b87edd38ca33-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-91960461-d651-4f33-a344-b87edd38ca33" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-91960461-d651-4f33-a344-b87edd38ca33" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a98b7-c76e-4461-81b6-88b601b78ba3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:28 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 Aug 04 12:34:28 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:28 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33" returned: 0 in 0.534s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:28 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33 Aug 04 12:34:28 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Acquiring lock "cinder-09e600a7-1c94-4631-84f8-97b10d394038-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "cinder-09e600a7-1c94-4631-84f8-97b10d394038-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Acquiring lock "cinder-quobyte-09e600a7-1c94-4631-84f8-97b10d394038" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "cinder-quobyte-09e600a7-1c94-4631-84f8-97b10d394038" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb84f28-b2c2-4a99-9074-06aa59636e1b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:29 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 Aug 04 12:34:29 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:29 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-91960461-d651-4f33-a344-b87edd38ca33" returned: 0 in 0.384s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-91960461-d651-4f33-a344-b87edd38ca33" released by "delete_volume" :: held 0.979s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['47eeb431-2887-424f-b616-9bd5bc73ae44', '1bf07d4e-a4bd-48ad-8d6a-975fab31764c', 'bdea7a83-87ab-46a1-b3f7-5480dfd125c2', 'cacd98ab-f95d-4fbe-a098-07c9346fc6a2'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:29 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:29 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:29 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038" returned: 0 in 0.614s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:29 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038 Aug 04 12:34:29 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:29 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b0dba888-8fdd-41ba-872f-02ac0dc8610c tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-91960461-d651-4f33-a344-b87edd38ca33-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:29 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-09e600a7-1c94-4631-84f8-97b10d394038" returned: 0 in 0.391s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "cinder-quobyte-09e600a7-1c94-4631-84f8-97b10d394038" released by "delete_volume" :: held 1.069s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=211,cinder:SELECT=177,cinder:INSERT=47,cinder:DELETE=19 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:34:29 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Created reservations ['49985e62-3893-44be-9d62-aa4d17370aa4', '0d7d5b38-0a01-4164-851c-56bc490ef068', '06ceb586-0b36-4a10-832b-4f5888378476', 'cd8fb436-0b18-4621-a03a-9fe4758c6e13'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:30 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:30 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:30 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-8bd906cc-5335-47a6-afdb-14aeefed22f5-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.285s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Deleted volume successfully. Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-8bd906cc-5335-47a6-afdb-14aeefed22f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9668cf8d-eecf-4978-9445-cfd2d1fcfc9e tempest-ProjectReaderTests-477630239 None] Lock "cinder-09e600a7-1c94-4631-84f8-97b10d394038-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-8bd906cc-5335-47a6-afdb-14aeefed22f5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-8bd906cc-5335-47a6-afdb-14aeefed22f5" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0f791-4455-48a8-933f-318cf5808fe6]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:30 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 Aug 04 12:34:30 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:30 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5" returned: 0 in 0.422s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:30 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5 Aug 04 12:34:30 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:31 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8bd906cc-5335-47a6-afdb-14aeefed22f5" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-8bd906cc-5335-47a6-afdb-14aeefed22f5" released by "delete_volume" :: held 0.806s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=233,cinder:SELECT=177,cinder:DELETE=18,cinder:INSERT=67 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['7ceecebe-635b-4132-898b-ddab27402125', 'ab36cffb-0dad-4a8b-94b2-e734133340c1', '3758359e-ea17-4882-b199-33a9f8199bf8', '7c0ac19a-2bdd-497b-9454-39349fa2a9a9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:31 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:31 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-b35e0973-ef5b-4539-a35c-877bd6e4d9f5-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-b35e0973-ef5b-4539-a35c-877bd6e4d9f5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Flow 'volume_create_manager' (1f25c5ec-8119-4084-a65c-58043a266157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f5585-6aeb-4a81-b92f-bd510d020490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f5585-6aeb-4a81-b92f-bd510d020490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260349521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e71b3f2-0696-4597-8511-107bee816e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cefb1ef30d3471cbf7be483015de923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:32Z,use_quota=True,user_id='6e22a0f8fc7a4aae8027d7b0cd38bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fdec5c-b3c5-4179-a0e6-a576b5cce019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fdec5c-b3c5-4179-a0e6-a576b5cce019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb463acd-9db0-45c9-b258-e4dff711b883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb463acd-9db0-45c9-b258-e4dff711b883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e71b3f2-0696-4597-8511-107bee816e95', 'volume_name': 'volume-2e71b3f2-0696-4597-8511-107bee816e95', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90305f1-0c72-474a-8e0e-eee2229df74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90305f1-0c72-474a-8e0e-eee2229df74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff654cdb-1c97-4b3d-ae86-24e4bd771092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Volume 2e71b3f2-0696-4597-8511-107bee816e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e71b3f2-0696-4597-8511-107bee816e95', 'volume_size': 1} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260349521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e71b3f2-0696-4597-8511-107bee816e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cefb1ef30d3471cbf7be483015de923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:32Z,use_quota=True,user_id='6e22a0f8fc7a4aae8027d7b0cd38bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Creating volume 2e71b3f2-0696-4597-8511-107bee816e95 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:31 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:31 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 1073741824 Aug 04 12:34:31 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" acquired by "delete_volume" :: waited 0.109s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d30103-5d87-461c-b20e-901cd64e7b23]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:32 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.493s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-515b8313-22e9-43ea-b6de-476edeebfa60 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-8bd906cc-5335-47a6-afdb-14aeefed22f5-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:32 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 Aug 04 12:34:32 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:32 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" returned: 0 in 0.550s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:32 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 1073741824" returned: 0 in 0.684s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:32 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5 Aug 04 12:34:32 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:32 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 Aug 04 12:34:32 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:32 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" returned: 0 in 0.446s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-b35e0973-ef5b-4539-a35c-877bd6e4d9f5" released by "delete_volume" :: held 1.068s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['15374723-61e3-4866-ae07-6f75b74c8434', '3938e914-9512-493e-801f-000b3935b5bf', '3e9d8b67-b94f-45c1-88bd-f98be5f971ff', 'cf137b6d-9c29-4e85-bad6-099879d8a40b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:33 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95" returned: 0 in 0.475s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff654cdb-1c97-4b3d-ae86-24e4bd771092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e71b3f2-0696-4597-8511-107bee816e95', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca51305-b45c-430b-91ca-2df7c9c336e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Volume volume-2e71b3f2-0696-4597-8511-107bee816e95 (2e71b3f2-0696-4597-8511-107bee816e95): created successfully Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca51305-b45c-430b-91ca-2df7c9c336e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Flow 'volume_create_manager' (1f25c5ec-8119-4084-a65c-58043a266157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fe4c834d-d8dd-4e1b-b8ca-f82f4ce414ec tempest-ProjectReaderTests-477630239 None] Created volume successfully. Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:33 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:33 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:33 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a1199f6c-0bde-454f-b7c8-ab294a82a9d5 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-b35e0973-ef5b-4539-a35c-877bd6e4d9f5-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Acquiring lock "cinder-2e71b3f2-0696-4597-8511-107bee816e95-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "cinder-2e71b3f2-0696-4597-8511-107bee816e95-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Acquiring lock "cinder-quobyte-2e71b3f2-0696-4597-8511-107bee816e95" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "cinder-quobyte-2e71b3f2-0696-4597-8511-107bee816e95" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0df644-e2d9-43d2-9cbf-fc3663327777]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-109743cc-e228-40ca-a4d6-8a886c68e98f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-109743cc-e228-40ca-a4d6-8a886c68e98f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-109743cc-e228-40ca-a4d6-8a886c68e98f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-109743cc-e228-40ca-a4d6-8a886c68e98f" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:34 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 Aug 04 12:34:34 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff412b5-a35e-4260-9b43-1c04da5df4c3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:34 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f Aug 04 12:34:34 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:34 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95" returned: 0 in 0.485s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:34 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95 Aug 04 12:34:34 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:34 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f" returned: 0 in 0.492s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:34 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f Aug 04 12:34:34 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:34 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2e71b3f2-0696-4597-8511-107bee816e95" returned: 0 in 0.298s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "cinder-quobyte-2e71b3f2-0696-4597-8511-107bee816e95" released by "delete_volume" :: held 0.844s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Created reservations ['5f02054e-8fa4-4811-a84d-e291bbb258ba', '72814763-cb03-4a68-b5e8-0df8870cd745', 'a41883a1-524b-4483-86fb-2d8816e5f170', '971a7da0-c779-4df2-9549-68a166fc7b04'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:35 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:35 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:35 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-109743cc-e228-40ca-a4d6-8a886c68e98f" returned: 0 in 0.380s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-109743cc-e228-40ca-a4d6-8a886c68e98f" released by "delete_volume" :: held 0.940s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['a2b6b330-d5dd-45b7-bc62-d172270f1a6b', 'b02471a9-f197-44d0-8916-f98078b07d37', '59574554-a40c-44d4-8127-9e2d6a787537', '819da0cf-5399-4dd4-b171-3a79db35f334'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:35 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.353s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Deleted volume successfully. Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3245ef91-8167-4201-8405-ae5967fcda76 tempest-ProjectReaderTests-477630239 None] Lock "cinder-2e71b3f2-0696-4597-8511-107bee816e95-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:35 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:35 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:35 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.429s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cb6c23af-5f68-4e0a-aff7-4db8ccceaad2 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-109743cc-e228-40ca-a4d6-8a886c68e98f-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "cinder-quobyte-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6597802-d4a0-422f-9e79-14a3c32b6237]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:36 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 Aug 04 12:34:36 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:36 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" returned: 0 in 0.393s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:36 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49 Aug 04 12:34:36 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:37 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" returned: 0 in 0.324s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-quobyte-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49" released by "delete_volume" :: held 0.775s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Created reservations ['83c77ceb-1644-4da5-b85a-1ba46783a299', '0390aa03-eef5-455a-b0f9-957cac7aae13', 'bdff29ee-c17b-4826-8479-27944c427486', '29d8140a-3d24-469b-8ed0-ed2c3099879d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:37 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:37 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:37 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.440s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Deleted volume successfully. Aug 04 12:34:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-256aebca-743d-47cc-aaa8-b75e9d3f4d08 tempest-CreateVolumesFromSourceVolumeTest-1400407449 None] Lock "cinder-4e5e341d-9fb8-4ee4-a16a-512bc17fbd49-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Flow 'volume_create_manager' (d47b6169-551a-4ea6-9a1e-04d8fe93b643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b069f-30f9-4007-940c-d21d2c3f5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b069f-30f9-4007-940c-d21d2c3f5d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1738459317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca17345-48c1-4ecf-b094-48097ed6900d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc6bdb42993484db4eb91e87f9bc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:44Z,use_quota=True,user_id='af77b18458934f02851650748d32de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c6d0a0-67b1-487e-ae31-2c7616650050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c6d0a0-67b1-487e-ae31-2c7616650050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38df552-54a6-4e8b-9df3-b91290e25977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38df552-54a6-4e8b-9df3-b91290e25977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca17345-48c1-4ecf-b094-48097ed6900d', 'volume_name': 'volume-eca17345-48c1-4ecf-b094-48097ed6900d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159dca6b-d02a-4fbf-ba50-e1de0dcf9733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159dca6b-d02a-4fbf-ba50-e1de0dcf9733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd77642-d6cd-45eb-9cd7-d888a35005c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume eca17345-48c1-4ecf-b094-48097ed6900d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca17345-48c1-4ecf-b094-48097ed6900d', 'volume_size': 1} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1738459317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca17345-48c1-4ecf-b094-48097ed6900d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc6bdb42993484db4eb91e87f9bc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:44Z,use_quota=True,user_id='af77b18458934f02851650748d32de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Creating volume eca17345-48c1-4ecf-b094-48097ed6900d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:44 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:44 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d 1073741824 Aug 04 12:34:44 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Flow 'volume_create_manager' (b20325a4-e581-4945-bd40-b25d326ed928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c441d9-342b-4ab0-aea0-86746e6733dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c441d9-342b-4ab0-aea0-86746e6733dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-934763304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f68b176-d19b-4138-b728-c7d569ca6e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc6bdb42993484db4eb91e87f9bc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:45Z,use_quota=True,user_id='af77b18458934f02851650748d32de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7257d548-d7c1-44d8-b7ef-b2a5c5ba7bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7257d548-d7c1-44d8-b7ef-b2a5c5ba7bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e34857f-0d61-48eb-b598-858d69654a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e34857f-0d61-48eb-b598-858d69654a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f68b176-d19b-4138-b728-c7d569ca6e00', 'volume_name': 'volume-3f68b176-d19b-4138-b728-c7d569ca6e00', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df67795-99dd-4e1d-a478-cc404a119b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df67795-99dd-4e1d-a478-cc404a119b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4f4831-a0d7-4490-902d-a8e9ca20ab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:44 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume 3f68b176-d19b-4138-b728-c7d569ca6e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f68b176-d19b-4138-b728-c7d569ca6e00', 'volume_size': 1} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:44 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d 1073741824" returned: 0 in 0.530s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:45 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d Aug 04 12:34:45 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:45 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d" returned: 0 in 0.294s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-934763304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f68b176-d19b-4138-b728-c7d569ca6e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc6bdb42993484db4eb91e87f9bc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:45Z,use_quota=True,user_id='af77b18458934f02851650748d32de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Creating volume 3f68b176-d19b-4138-b728-c7d569ca6e00 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:45 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd77642-d6cd-45eb-9cd7-d888a35005c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca17345-48c1-4ecf-b094-48097ed6900d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfaa767-4f20-4713-b2fc-3dd807c113ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:45 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume volume-eca17345-48c1-4ecf-b094-48097ed6900d (eca17345-48c1-4ecf-b094-48097ed6900d): created successfully Aug 04 12:34:45 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 1073741824 Aug 04 12:34:45 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfaa767-4f20-4713-b2fc-3dd807c113ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Flow 'volume_create_manager' (d47b6169-551a-4ea6-9a1e-04d8fe93b643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6b21abb4-4d3b-47cf-866c-b119888908ed tempest-TestServerVolumeAttachmentScenario-216459539 None] Created volume successfully. Aug 04 12:34:45 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 1073741824" returned: 0 in 0.565s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:45 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 Aug 04 12:34:45 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:46 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4f4831-a0d7-4490-902d-a8e9ca20ab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f68b176-d19b-4138-b728-c7d569ca6e00', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae28e557-444b-4359-b8d7-76cb1ddd885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Volume volume-3f68b176-d19b-4138-b728-c7d569ca6e00 (3f68b176-d19b-4138-b728-c7d569ca6e00): created successfully Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae28e557-444b-4359-b8d7-76cb1ddd885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Flow 'volume_create_manager' (b20325a4-e581-4945-bd40-b25d326ed928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-60880534-dcb8-4d46-b9f5-c28766fccbe2 tempest-TestServerVolumeAttachmentScenario-216459539 None] Created volume successfully. Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (3a3cc5a0-9832-4324-bd16-796c40b2be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c207130-f685-49eb-b86a-4d8062913c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c207130-f685-49eb-b86a-4d8062913c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593042099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d75023-86ca-47f2-9c5c-985f01d94798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:48Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de94bda-9476-4e07-a408-ad9f6e348e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de94bda-9476-4e07-a408-ad9f6e348e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e6e98-928a-4da8-9006-f54547053b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e6e98-928a-4da8-9006-f54547053b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d75023-86ca-47f2-9c5c-985f01d94798', 'volume_name': 'volume-92d75023-86ca-47f2-9c5c-985f01d94798', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652a86fb-8cf6-40d9-b3d3-ce9bb90897e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652a86fb-8cf6-40d9-b3d3-ce9bb90897e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1dcc49-b3a0-43af-95e2-86ee7e819335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Volume 92d75023-86ca-47f2-9c5c-985f01d94798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d75023-86ca-47f2-9c5c-985f01d94798', 'volume_size': 1} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593042099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d75023-86ca-47f2-9c5c-985f01d94798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:48Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Creating volume 92d75023-86ca-47f2-9c5c-985f01d94798 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:47 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:47 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 1073741824 Aug 04 12:34:47 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:48 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 1073741824" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:48 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 Aug 04 12:34:48 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:48 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798" returned: 0 in 0.270s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1dcc49-b3a0-43af-95e2-86ee7e819335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d75023-86ca-47f2-9c5c-985f01d94798', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464cbf0d-acc4-47ae-b76a-a18e02225128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Volume volume-92d75023-86ca-47f2-9c5c-985f01d94798 (92d75023-86ca-47f2-9c5c-985f01d94798): created successfully Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464cbf0d-acc4-47ae-b76a-a18e02225128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (3a3cc5a0-9832-4324-bd16-796c40b2be07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ac009cf5-fde2-4898-9a2c-ba552785ef3e tempest-ProjectReaderTests-480190255 None] Created volume successfully. Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-92d75023-86ca-47f2-9c5c-985f01d94798-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "cinder-92d75023-86ca-47f2-9c5c-985f01d94798-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-quobyte-92d75023-86ca-47f2-9c5c-985f01d94798" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-92d75023-86ca-47f2-9c5c-985f01d94798" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a8bac-1a26-43f1-bba7-1ef15688df0f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 Aug 04 12:34:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:49 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798" returned: 0 in 0.398s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:49 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798 Aug 04 12:34:49 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:49 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-92d75023-86ca-47f2-9c5c-985f01d94798" returned: 0 in 0.352s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-92d75023-86ca-47f2-9c5c-985f01d94798" released by "delete_volume" :: held 0.807s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Created reservations ['24f84174-98c5-4a26-9c1e-2a23969d20ae', 'dfe3c7f8-406c-4b11-b5bf-882973401a7e', '76c0e1c8-1502-46c8-a7f5-94ab4551ad95', '67810bf0-c725-40d2-98f9-b472d7075936'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:50 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:50 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:50 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.267s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Deleted volume successfully. Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9f32e4b0-6dbf-434b-be01-d3cf0d79c15c tempest-ProjectReaderTests-480190255 None] Lock "cinder-92d75023-86ca-47f2-9c5c-985f01d94798-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (106970c1-7af0-43be-b2c5-acc21bc5a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc9b3b0-b6cf-4039-a85f-3f8f1263f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc9b3b0-b6cf-4039-a85f-3f8f1263f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65055664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cd15d5-eb4d-4a90-b364-01bbd19a42ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:51Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295f3aed-25df-4204-8570-7c51da6d6323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295f3aed-25df-4204-8570-7c51da6d6323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5303df-266f-4c57-a735-8d8fb7de1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5303df-266f-4c57-a735-8d8fb7de1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cd15d5-eb4d-4a90-b364-01bbd19a42ec', 'volume_name': 'volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bacafad-5ecf-48d6-abf6-04fe0a08b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bacafad-5ecf-48d6-abf6-04fe0a08b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056867b9-095c-4cbf-a38a-382fe11a0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Volume e9cd15d5-eb4d-4a90-b364-01bbd19a42ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec', 'volume_size': 1} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65055664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cd15d5-eb4d-4a90-b364-01bbd19a42ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:51Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Creating volume e9cd15d5-eb4d-4a90-b364-01bbd19a42ec {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:50 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec 1073741824 Aug 04 12:34:50 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:51 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec 1073741824" returned: 0 in 0.479s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:51 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec Aug 04 12:34:51 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:51 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056867b9-095c-4cbf-a38a-382fe11a0b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f7b340-9d93-4456-acf7-700cd176d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Volume volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec (e9cd15d5-eb4d-4a90-b364-01bbd19a42ec): created successfully Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f7b340-9d93-4456-acf7-700cd176d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (106970c1-7af0-43be-b2c5-acc21bc5a161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e85f4894-3d52-4ddc-ba89-7264fe1656c7 tempest-ProjectReaderTests-480190255 None] Created volume successfully. Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "cinder-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-quobyte-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a894e-5158-429a-b2f1-7a857608220e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:53 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec Aug 04 12:34:53 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:53 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" returned: 0 in 0.388s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:53 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec Aug 04 12:34:53 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:53 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" returned: 0 in 0.253s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec" released by "delete_volume" :: held 0.700s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Created reservations ['272ccc43-2dcb-41a9-860c-d2cea9d0d848', 'eca27902-d82e-4281-997a-91c0a4ca7db1', 'b1885dc4-968f-4d80-9610-5a6c7079d7f5', '710979b0-36db-43ad-a622-d8a765c4117b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:54 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:54 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:54 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.288s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Deleted volume successfully. Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f92269f6-7c71-4008-adc3-b1677205fd29 tempest-ProjectReaderTests-480190255 None] Lock "cinder-e9cd15d5-eb4d-4a90-b364-01bbd19a42ec-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (ef9a8e74-e7c8-4a15-810c-6b4a1a6ddc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e721e050-08e6-4e30-b6ec-30179efdaba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e721e050-08e6-4e30-b6ec-30179efdaba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784115204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b57486-74aa-4750-b9a6-f13f94d4b679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:55Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c3ccc-bb25-4e5f-8e3c-b134c2c1949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c3ccc-bb25-4e5f-8e3c-b134c2c1949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed512dd-193a-42b0-8ff6-d87ce670ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed512dd-193a-42b0-8ff6-d87ce670ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b57486-74aa-4750-b9a6-f13f94d4b679', 'volume_name': 'volume-a4b57486-74aa-4750-b9a6-f13f94d4b679', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83428d72-38e7-49bc-a074-01994e0c64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83428d72-38e7-49bc-a074-01994e0c64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321b130-c4e9-44dc-aacc-fcff2d674162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Volume a4b57486-74aa-4750-b9a6-f13f94d4b679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b57486-74aa-4750-b9a6-f13f94d4b679', 'volume_size': 1} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784115204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b57486-74aa-4750-b9a6-f13f94d4b679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:55Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Creating volume a4b57486-74aa-4750-b9a6-f13f94d4b679 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:54 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:54 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 1073741824 Aug 04 12:34:54 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:55 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 1073741824" returned: 0 in 0.500s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:55 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 Aug 04 12:34:55 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:55 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321b130-c4e9-44dc-aacc-fcff2d674162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b57486-74aa-4750-b9a6-f13f94d4b679', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5eca288-bcc4-4707-b610-8aa77653031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Volume volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 (a4b57486-74aa-4750-b9a6-f13f94d4b679): created successfully Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5eca288-bcc4-4707-b610-8aa77653031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (ef9a8e74-e7c8-4a15-810c-6b4a1a6ddc60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b0af11e4-445f-402a-906d-91035e1617fd tempest-ProjectReaderTests-480190255 None] Created volume successfully. Aug 04 12:34:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-a4b57486-74aa-4750-b9a6-f13f94d4b679-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "cinder-a4b57486-74aa-4750-b9a6-f13f94d4b679-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-quobyte-a4b57486-74aa-4750-b9a6-f13f94d4b679" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-a4b57486-74aa-4750-b9a6-f13f94d4b679" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03533bf-b194-435f-b07f-160bdeea96ae]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:57 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 Aug 04 12:34:57 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:57 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:57 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679 Aug 04 12:34:57 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:57 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a4b57486-74aa-4750-b9a6-f13f94d4b679" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-a4b57486-74aa-4750-b9a6-f13f94d4b679" released by "delete_volume" :: held 0.721s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Created reservations ['089313f2-fa2f-4af4-bf59-5e736a2b409d', '5a075448-e40b-4707-827e-b2da18a81189', 'a9970b27-c94a-4555-bba2-25ac24f0c3ac', '547ec3d6-e354-4796-89dc-eca96252c3c9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:57 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:34:57 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:58 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:34:58 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Deleted volume successfully. Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-da9c0e8e-1fcd-4410-bea7-5081e6e25acf tempest-ProjectReaderTests-480190255 None] Lock "cinder-a4b57486-74aa-4750-b9a6-f13f94d4b679-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (c546f509-8c67-469e-b337-3c1b1bafbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3210c4d-f370-4f2a-84df-2b5df8cc2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3210c4d-f370-4f2a-84df-2b5df8cc2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060397558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f490c3a7-341f-44e2-88fb-dda534db5aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:59Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eddd7d-85a8-41a8-af1a-382ab48978e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eddd7d-85a8-41a8-af1a-382ab48978e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1489990a-fab5-47de-abbd-53910343cbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1489990a-fab5-47de-abbd-53910343cbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f490c3a7-341f-44e2-88fb-dda534db5aa3', 'volume_name': 'volume-f490c3a7-341f-44e2-88fb-dda534db5aa3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b83f0e-9c93-4456-9b17-69bef9205e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b83f0e-9c93-4456-9b17-69bef9205e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1416ad-cda7-4b3d-90e9-f8799115cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Volume f490c3a7-341f-44e2-88fb-dda534db5aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f490c3a7-341f-44e2-88fb-dda534db5aa3', 'volume_size': 1} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060397558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f490c3a7-341f-44e2-88fb-dda534db5aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593c6b9bf76447829f9252b05c94a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:34:59Z,use_quota=True,user_id='3fa6f0d047614bcdab953675568b5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Creating volume f490c3a7-341f-44e2-88fb-dda534db5aa3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:34:58 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:34:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:58 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 1073741824 Aug 04 12:34:58 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:59 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 1073741824" returned: 0 in 0.411s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:59 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 Aug 04 12:34:59 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:34:59 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3" returned: 0 in 0.258s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1416ad-cda7-4b3d-90e9-f8799115cada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f490c3a7-341f-44e2-88fb-dda534db5aa3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ce0ec2-9d0e-44aa-96fb-1a5d3cb55047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:34:59 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Volume volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 (f490c3a7-341f-44e2-88fb-dda534db5aa3): created successfully Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ce0ec2-9d0e-44aa-96fb-1a5d3cb55047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Flow 'volume_create_manager' (c546f509-8c67-469e-b337-3c1b1bafbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:34:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c3c923c2-a419-4632-8c80-b9e2538d3ae9 tempest-ProjectReaderTests-480190255 None] Created volume successfully. Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-f490c3a7-341f-44e2-88fb-dda534db5aa3-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "cinder-f490c3a7-341f-44e2-88fb-dda534db5aa3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Acquiring lock "cinder-quobyte-f490c3a7-341f-44e2-88fb-dda534db5aa3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-f490c3a7-341f-44e2-88fb-dda534db5aa3" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2674a51a-93ab-4e90-ab4f-7daae8996bd4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:34:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:34:59 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 Aug 04 12:34:59 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:00 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:00 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3 Aug 04 12:35:00 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:00 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f490c3a7-341f-44e2-88fb-dda534db5aa3" returned: 0 in 0.270s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "cinder-quobyte-f490c3a7-341f-44e2-88fb-dda534db5aa3" released by "delete_volume" :: held 0.664s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Created reservations ['a7bd9ae0-5426-42f9-be92-17f684dc3ddf', '298d4a9e-0ecd-4849-b458-5763c8f9e3cb', 'c3b98a23-784f-42dc-b49c-2cd0ed98b69a', '39f1ff0a-4393-4126-9d42-97e97c11a74c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:00 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:35:00 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:00 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.269s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:35:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Deleted volume successfully. Aug 04 12:35:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7c7188db-b424-4a37-9356-01ec1f28e081 tempest-ProjectReaderTests-480190255 None] Lock "cinder-f490c3a7-341f-44e2-88fb-dda534db5aa3-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:06 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:35:06 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:06 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:35:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:35:10 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=92,cinder:SELECT=56,cinder:INSERT=21,cinder:DELETE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:35:10 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:INSERT=24,cinder:UPDATE=99,cinder:SELECT=63,cinder:DELETE=12 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:35:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2f4c609f-86ee-43bb-b54f-0069a98adfb3 req-2c8294b0-8341-4f7e-a6ff-c4b96533a222 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2f4c609f-86ee-43bb-b54f-0069a98adfb3 req-2c8294b0-8341-4f7e-a6ff-c4b96533a222 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-2f4c609f-86ee-43bb-b54f-0069a98adfb3 req-2c8294b0-8341-4f7e-a6ff-c4b96533a222 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-2f4c609f-86ee-43bb-b54f-0069a98adfb3 req-2c8294b0-8341-4f7e-a6ff-c4b96533a222 tempest-TestServerVolumeAttachmentScenario-216459539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-eca17345-48c1-4ecf-b094-48097ed6900d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f358fc74-0f1e-4c98-9b02-eb7b55b5ac0e', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:35:17 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-2f4c609f-86ee-43bb-b54f-0069a98adfb3 req-2c8294b0-8341-4f7e-a6ff-c4b96533a222 tempest-TestServerVolumeAttachmentScenario-216459539 None] attachment_update completed successfully. Aug 04 12:35:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a25702cb-a5e5-45dc-954b-542242ab2611 req-f6f60af8-a0c6-41f7-878f-b91a881303af tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a25702cb-a5e5-45dc-954b-542242ab2611 req-f6f60af8-a0c6-41f7-878f-b91a881303af tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [req-a25702cb-a5e5-45dc-954b-542242ab2611 req-f6f60af8-a0c6-41f7-878f-b91a881303af tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-a25702cb-a5e5-45dc-954b-542242ab2611 req-f6f60af8-a0c6-41f7-878f-b91a881303af tempest-TestServerVolumeAttachmentScenario-216459539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3', 'name': 'volume-3f68b176-d19b-4138-b728-c7d569ca6e00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b285aae9-e6d4-4d52-928d-8ef1f906f6d3', 'enforce_multipath': True} {{(pid=88895) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 04 12:35:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-a25702cb-a5e5-45dc-954b-542242ab2611 req-f6f60af8-a0c6-41f7-878f-b91a881303af tempest-TestServerVolumeAttachmentScenario-216459539 None] attachment_update completed successfully. Aug 04 12:35:24 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-19826f00-3b5e-46ba-bc15-2779d600b2b6 req-9949c980-bfa6-44df-8383-04e21d474c0a tempest-TestServerVolumeAttachmentScenario-216459539 None] Terminate volume connection completed successfully. Aug 04 12:35:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-19826f00-3b5e-46ba-bc15-2779d600b2b6 req-9949c980-bfa6-44df-8383-04e21d474c0a tempest-TestServerVolumeAttachmentScenario-216459539 None] Deleting attachment b285aae9-e6d4-4d52-928d-8ef1f906f6d3. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:35:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [req-4e86b67d-4860-4003-9763-444b449ade79 req-2e7f8a9e-7e6c-48a2-a83c-4f8012af7ac3 tempest-TestServerVolumeAttachmentScenario-216459539 None] Terminate volume connection completed successfully. Aug 04 12:35:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [req-4e86b67d-4860-4003-9763-444b449ade79 req-2e7f8a9e-7e6c-48a2-a83c-4f8012af7ac3 tempest-TestServerVolumeAttachmentScenario-216459539 None] Deleting attachment f358fc74-0f1e-4c98-9b02-eb7b55b5ac0e. {{(pid=88895) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "cinder-3f68b176-d19b-4138-b728-c7d569ca6e00-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-3f68b176-d19b-4138-b728-c7d569ca6e00-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "cinder-quobyte-3f68b176-d19b-4138-b728-c7d569ca6e00" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-quobyte-3f68b176-d19b-4138-b728-c7d569ca6e00" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40db72e-7b3b-44ae-973d-3789ee639911]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:30 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 Aug 04 12:35:30 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:30 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:30 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00 Aug 04 12:35:30 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:30 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3f68b176-d19b-4138-b728-c7d569ca6e00" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-quobyte-3f68b176-d19b-4138-b728-c7d569ca6e00" released by "delete_volume" :: held 0.638s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Created reservations ['e7f79788-a0f5-4b5d-b91e-7c32db9b279d', 'bf06e80b-00dc-4c11-97c5-7255ebafd72f', '0c6a1d68-15ac-4eb1-8834-28b34f7ef9b7', '8b355d04-7f01-416b-8f3e-29c9dd519d56'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:30 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:35:30 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:30 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:35:30 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Deleted volume successfully. Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98a16521-eff0-40d1-85b4-ada41b2574f8 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-3f68b176-d19b-4138-b728-c7d569ca6e00-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "cinder-eca17345-48c1-4ecf-b094-48097ed6900d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-eca17345-48c1-4ecf-b094-48097ed6900d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "cinder-quobyte-eca17345-48c1-4ecf-b094-48097ed6900d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-quobyte-eca17345-48c1-4ecf-b094-48097ed6900d" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb9e863-41e3-4927-b780-565d4a8ad56f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:31 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d Aug 04 12:35:31 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:31 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:31 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d Aug 04 12:35:31 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:31 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eca17345-48c1-4ecf-b094-48097ed6900d" returned: 0 in 0.247s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-quobyte-eca17345-48c1-4ecf-b094-48097ed6900d" released by "delete_volume" :: held 0.630s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Created reservations ['11dad646-7bda-4e22-b2d8-741e0d258d8d', '8d0c8aa3-df0e-498f-821c-1c892924ab26', '7fba6218-2da1-4e7d-8c34-64cbd121635a', '69b85183-06af-49da-8cd3-7ca2842dbabe'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:31 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:35:31 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:32 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:32 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:35:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Deleted volume successfully. Aug 04 12:35:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-90d2c288-3bb8-4061-8541-ecf31ed1c249 tempest-TestServerVolumeAttachmentScenario-216459539 None] Lock "cinder-eca17345-48c1-4ecf-b094-48097ed6900d-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:41 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:35:42 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=28,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Flow 'volume_create_manager' (3f5c4032-7a74-4b9b-9abd-1c6a46990d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd30f87-b3b3-4ac7-836c-83cafa25d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd30f87-b3b3-4ac7-836c-83cafa25d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609b04-982e-4ee1-97c8-43739dd43422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74333ed986054f3c98f3574dab6997cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:44Z,use_quota=True,user_id='409ae1ace37041cf8816eee14f0f0feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f299e77a-f374-420c-aaa1-57c38135fae1),volume_type_id=f299e77a-f374-420c-aaa1-57c38135fae1)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f8831d-19dc-4a87-8740-c8bfd1a66510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f8831d-19dc-4a87-8740-c8bfd1a66510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92ece1a-696e-434a-bfcc-69965584f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92ece1a-696e-434a-bfcc-69965584f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb609b04-982e-4ee1-97c8-43739dd43422', 'volume_name': 'volume-eb609b04-982e-4ee1-97c8-43739dd43422', 'volume_size': 1, 'image_id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d3e27cc032f3787a96ffbebf453d69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74333ed986054f3c98f3574dab6997cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fd2b1d4a73e8f202313cbd0a776ca1ba4696d91794f56e21169e5f5d0f4ea9aa5f17a17f17153c17d09afd3f9e1240bbd1a1708cb77d3314554f9fddc011777', 'id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'created_at': datetime.datetime(2026, 8, 4, 10, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f75c39-33bd-4c59-9b04-370f6edd46a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f75c39-33bd-4c59-9b04-370f6edd46a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5786ff09-40d5-4d3e-b590-3954e3605bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:44 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Volume eb609b04-982e-4ee1-97c8-43739dd43422: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb609b04-982e-4ee1-97c8-43739dd43422', 'volume_size': 1, 'image_id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d3e27cc032f3787a96ffbebf453d69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74333ed986054f3c98f3574dab6997cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fd2b1d4a73e8f202313cbd0a776ca1ba4696d91794f56e21169e5f5d0f4ea9aa5f17a17f17153c17d09afd3f9e1240bbd1a1708cb77d3314554f9fddc011777', 'id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'created_at': datetime.datetime(2026, 8, 4, 10, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Trying to clone eb609b04-982e-4ee1-97c8-43739dd43422 from image 38baa1e3-d203-4d06-bec5-fb3388d93b1f at location (None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:35:44 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Image download 0.00 MB at 0.00 MB/s Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe9d7d5-828b-4f1d-bb9a-375c53e1b78e]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:44 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:44 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:44 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:45 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:45 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:45 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Temporary image 38baa1e3-d203-4d06-bec5-fb3388d93b1f is fetched for user 409ae1ace37041cf8816eee14f0f0feb. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe067b-8d72-4201-971c-3fe8d2292df9]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:45 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:45 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:45 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:45 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:45 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:45 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609b04-982e-4ee1-97c8-43739dd43422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74333ed986054f3c98f3574dab6997cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:44Z,use_quota=True,user_id='409ae1ace37041cf8816eee14f0f0feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f299e77a-f374-420c-aaa1-57c38135fae1),volume_type_id=f299e77a-f374-420c-aaa1-57c38135fae1)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Creating volume eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:46 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:46 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1073741824 Aug 04 12:35:46 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:46 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1073741824" returned: 0 in 0.416s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:46 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 Aug 04 12:35:46 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:46 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Attempting download of 38baa1e3-d203-4d06-bec5-fb3388d93b1f ((None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}])) to volume eb609b04-982e-4ee1-97c8-43739dd43422. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8764fe-002d-4cfa-9aa1-683da2b95599]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:46 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi Aug 04 12:35:46 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:47 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi" returned: 0 in 0.329s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:47 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi Aug 04 12:35:47 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:47 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi" returned: 1 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38baa1e3-d203-4d06-bec5-fb3388d93b1f_lzroasyi' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6894ba74-08b8-40d6-a97a-532cfc3a4119]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:47 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:47 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:47 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:47 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD Aug 04 12:35:47 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:48 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] 38baa1e3-d203-4d06-bec5-fb3388d93b1f was raw, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:48 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 Aug 04 12:35:48 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:48 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422" returned: 0 in 0.434s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_38baa1e3-d203-4d06-bec5-fb3388d93b1f_48h7mvoedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:35:48 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Converted 0.00 MB image at 0.00 MB/s Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:48 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1G Aug 04 12:35:48 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:48 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 1G" returned: 0 in 0.306s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Downloaded image 38baa1e3-d203-4d06-bec5-fb3388d93b1f ((None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}])) to volume eb609b04-982e-4ee1-97c8-43739dd43422 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Temporary image 38baa1e3-d203-4d06-bec5-fb3388d93b1f for user 409ae1ace37041cf8816eee14f0f0feb is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Marking volume eb609b04-982e-4ee1-97c8-43739dd43422 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Copying metadata from image 38baa1e3-d203-4d06-bec5-fb3388d93b1f to eb609b04-982e-4ee1-97c8-43739dd43422. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Creating volume glance metadata for volume eb609b04-982e-4ee1-97c8-43739dd43422 backed by image 38baa1e3-d203-4d06-bec5-fb3388d93b1f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f6d3e27cc032f3787a96ffbebf453d69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5786ff09-40d5-4d3e-b590-3954e3605bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb609b04-982e-4ee1-97c8-43739dd43422', 'volume_size': 1, 'image_id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6d3e27cc032f3787a96ffbebf453d69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74333ed986054f3c98f3574dab6997cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fd2b1d4a73e8f202313cbd0a776ca1ba4696d91794f56e21169e5f5d0f4ea9aa5f17a17f17153c17d09afd3f9e1240bbd1a1708cb77d3314554f9fddc011777', 'id': '38baa1e3-d203-4d06-bec5-fb3388d93b1f', 'created_at': datetime.datetime(2026, 8, 4, 10, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38baa1e3-d203-4d06-bec5-fb3388d93b1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8d4034-47be-42c4-a5e8-b8bb4a657ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Volume volume-eb609b04-982e-4ee1-97c8-43739dd43422 (eb609b04-982e-4ee1-97c8-43739dd43422): created successfully Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8d4034-47be-42c4-a5e8-b8bb4a657ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Flow 'volume_create_manager' (3f5c4032-7a74-4b9b-9abd-1c6a46990d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fbb29998-4ff5-40e6-94e8-3d57c124b2d5 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Created volume successfully. Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Acquiring lock "cinder-eb609b04-982e-4ee1-97c8-43739dd43422-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "cinder-eb609b04-982e-4ee1-97c8-43739dd43422-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Acquiring lock "cinder-quobyte-eb609b04-982e-4ee1-97c8-43739dd43422" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "cinder-quobyte-eb609b04-982e-4ee1-97c8-43739dd43422" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[247a9f84-3be1-4a6e-99ed-4ca0d8c5c37c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:49 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 Aug 04 12:35:49 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:49 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422" returned: 0 in 0.353s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:50 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422 Aug 04 12:35:50 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:50 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eb609b04-982e-4ee1-97c8-43739dd43422" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "cinder-quobyte-eb609b04-982e-4ee1-97c8-43739dd43422" released by "delete_volume" :: held 0.641s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:50 devstack cinder-volume[88895]: WARNING cinder.quota [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:35:50 devstack cinder-volume[88895]: WARNING cinder.quota [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Created reservations ['9aa4718d-01ad-4eff-8e46-ff9284654df7', '7aac96c5-198c-4d8a-96f7-efa7f9b1b258', '33ba1e6e-401a-4b35-a7bc-2b2e758b2e39', 'f5718e57-5b00-4424-b2d7-ff4173940c30'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:50 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:35:50 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:50 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:35:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Deleted volume successfully. Aug 04 12:35:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-5633f963-375f-4a4c-b23a-672a80ad8746 tempest-VolumeAndVolumeTypeFromImageTest-1699811967 None] Lock "cinder-eb609b04-982e-4ee1-97c8-43739dd43422-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (282ed8bb-5bf8-4715-94ac-bfd8fe5f2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b4fe6-de2c-4c0a-b277-9647b4d3d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b4fe6-de2c-4c0a-b277-9647b4d3d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410225388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640518fd-f00b-4f92-a94e-424e50f4c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815e705b-f117-47b2-86d7-d5de8fbaea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815e705b-f117-47b2-86d7-d5de8fbaea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae79ef04-6e6f-4ee8-8803-84b6d8f51ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae79ef04-6e6f-4ee8-8803-84b6d8f51ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640518fd-f00b-4f92-a94e-424e50f4c025', 'volume_name': 'volume-640518fd-f00b-4f92-a94e-424e50f4c025', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0689669-599c-4e96-8c52-79776b43ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0689669-599c-4e96-8c52-79776b43ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369a16e1-de22-4e3f-8604-1d22c10ee43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Volume 640518fd-f00b-4f92-a94e-424e50f4c025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640518fd-f00b-4f92-a94e-424e50f4c025', 'volume_size': 1} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410225388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640518fd-f00b-4f92-a94e-424e50f4c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Creating volume 640518fd-f00b-4f92-a94e-424e50f4c025 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:54 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:54 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 1073741824 Aug 04 12:35:54 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (85ef701d-84db-4693-afbd-a249e029992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d49bafa-c28b-4d13-99ac-d6dabd1294d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d49bafa-c28b-4d13-99ac-d6dabd1294d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144235314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07462d92-5fb9-4a73-9fff-e77331bdb034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07462d92-5fb9-4a73-9fff-e77331bdb034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0083d4d5-f299-4720-b050-29106488027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0083d4d5-f299-4720-b050-29106488027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a', 'volume_name': 'volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d915e03-1400-41ca-944a-2c4061ed7cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d915e03-1400-41ca-944a-2c4061ed7cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c14589-f6ab-43da-9d17-a572f2f5c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Volume 4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a', 'volume_size': 1} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:55 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 1073741824" returned: 0 in 0.464s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:55 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 Aug 04 12:35:55 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (1fea2354-4843-4eff-b640-ac6f67d266b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b3460-073b-4e94-8421-3fd6c72fba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b3460-073b-4e94-8421-3fd6c72fba5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849640646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29adeb8c-1c5a-4c19-a693-745f3dabc633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a74c1-f58d-4a71-8d78-51cc666de2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a74c1-f58d-4a71-8d78-51cc666de2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9795f60-ceaa-4eb9-9685-72e82b5ff678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9795f60-ceaa-4eb9-9685-72e82b5ff678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29adeb8c-1c5a-4c19-a693-745f3dabc633', 'volume_name': 'volume-29adeb8c-1c5a-4c19-a693-745f3dabc633', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9212f9-c0be-42ea-b512-8570a43c6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9212f9-c0be-42ea-b512-8570a43c6a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736d3a0-ed5c-4878-881f-29ba4ec3ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Volume 29adeb8c-1c5a-4c19-a693-745f3dabc633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29adeb8c-1c5a-4c19-a693-745f3dabc633', 'volume_size': 1} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:55 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025" returned: 0 in 0.344s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144235314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Creating volume 4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:55 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a 1073741824 Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369a16e1-de22-4e3f-8604-1d22c10ee43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640518fd-f00b-4f92-a94e-424e50f4c025', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a4a51c-60ad-42ed-88e5-80a3c15d840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Volume volume-640518fd-f00b-4f92-a94e-424e50f4c025 (640518fd-f00b-4f92-a94e-424e50f4c025): created successfully Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a4a51c-60ad-42ed-88e5-80a3c15d840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (282ed8bb-5bf8-4715-94ac-bfd8fe5f2656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d2185bff-6d08-48bc-9e6d-6b0c8432182d tempest-CreateVolumesFromImageTest-465615241 None] Created volume successfully. Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (d41857dc-e874-4569-9b8d-de2eeb6c239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd03bbaf-2cc2-4199-aea8-2aa024541dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd03bbaf-2cc2-4199-aea8-2aa024541dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383861122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b586887c-25ec-4e3e-8a1f-bf3ccb044449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:56Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e79cef-d0e2-43cd-b479-16c58aa5de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e79cef-d0e2-43cd-b479-16c58aa5de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eefd4c-66b3-4d16-8b6b-ef4e385c7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eefd4c-66b3-4d16-8b6b-ef4e385c7293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b586887c-25ec-4e3e-8a1f-bf3ccb044449', 'volume_name': 'volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046cefd6-bbbe-462c-86c6-aee8e3ecdcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046cefd6-bbbe-462c-86c6-aee8e3ecdcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792371b7-6733-4bee-ad14-a353230b562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Volume b586887c-25ec-4e3e-8a1f-bf3ccb044449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449', 'volume_size': 1} Aug 04 12:35:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:35:56 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (9b3920ed-0f39-49b5-866f-deceb717b767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1c427c-4365-43d9-acdd-39b72280bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a 1073741824" returned: 0 in 0.536s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1c427c-4365-43d9-acdd-39b72280bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773012420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f53090-3fbb-42b9-acb2-05091a7fdae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:56Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8ab22-0f88-44bf-a742-90ad9709a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8ab22-0f88-44bf-a742-90ad9709a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe3fe1d-c11d-4590-9159-58f3f612d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe3fe1d-c11d-4590-9159-58f3f612d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f53090-3fbb-42b9-acb2-05091a7fdae2', 'volume_name': 'volume-41f53090-3fbb-42b9-acb2-05091a7fdae2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a19ad30-b799-4f42-a8d6-272f49f1b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a19ad30-b799-4f42-a8d6-272f49f1b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff579ff1-1ac3-43bd-8108-81416267c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Volume 41f53090-3fbb-42b9-acb2-05091a7fdae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f53090-3fbb-42b9-acb2-05091a7fdae2', 'volume_size': 1} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:56 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a Aug 04 12:35:56 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:56 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" returned: 0 in 0.240s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849640646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29adeb8c-1c5a-4c19-a693-745f3dabc633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:55Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Creating volume 29adeb8c-1c5a-4c19-a693-745f3dabc633 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:56 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:56 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 1073741824 Aug 04 12:35:56 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c14589-f6ab-43da-9d17-a572f2f5c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced7c19a-b7a8-4ec2-b409-1fe8a9eb9c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Volume volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a (4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a): created successfully Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced7c19a-b7a8-4ec2-b409-1fe8a9eb9c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (85ef701d-84db-4693-afbd-a249e029992e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bfa15d58-42e1-4f1e-8fe3-b0e265fdad44 tempest-CreateVolumesFromImageTest-465615241 None] Created volume successfully. Aug 04 12:35:56 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 1073741824" returned: 0 in 0.411s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:57 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 Aug 04 12:35:57 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:57 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383861122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b586887c-25ec-4e3e-8a1f-bf3ccb044449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:56Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Creating volume b586887c-25ec-4e3e-8a1f-bf3ccb044449 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736d3a0-ed5c-4878-881f-29ba4ec3ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29adeb8c-1c5a-4c19-a693-745f3dabc633', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9ce5c7-0575-4273-91b1-7e0f9d586bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:57 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 1073741824 Aug 04 12:35:57 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Volume volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 (29adeb8c-1c5a-4c19-a693-745f3dabc633): created successfully Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9ce5c7-0575-4273-91b1-7e0f9d586bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (1fea2354-4843-4eff-b640-ac6f67d266b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-426ad487-cfce-48c8-b6d4-08e810fff49d tempest-CreateVolumesFromImageTest-465615241 None] Created volume successfully. Aug 04 12:35:57 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 1073741824" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:57 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 Aug 04 12:35:57 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:57 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773012420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f53090-3fbb-42b9-acb2-05091a7fdae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f842a49bde1f4ed7985cbfd8a8154700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:35:56Z,use_quota=True,user_id='a8dfea567b7f4345998ca4898efeef8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Creating volume 41f53090-3fbb-42b9-acb2-05091a7fdae2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792371b7-6733-4bee-ad14-a353230b562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:57 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 1073741824 Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9c814b-0ea1-4f90-a0d6-fee4846114e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:57 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Volume volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 (b586887c-25ec-4e3e-8a1f-bf3ccb044449): created successfully Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9c814b-0ea1-4f90-a0d6-fee4846114e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (d41857dc-e874-4569-9b8d-de2eeb6c239b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c1dfde40-f1f2-4312-a28c-1d742fdfd26e tempest-CreateVolumesFromImageTest-465615241 None] Created volume successfully. Aug 04 12:35:58 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 1073741824" returned: 0 in 0.396s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:58 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 Aug 04 12:35:58 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:35:58 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2" returned: 0 in 0.252s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff579ff1-1ac3-43bd-8108-81416267c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f53090-3fbb-42b9-acb2-05091a7fdae2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aaa363-6a65-49aa-8714-9849c1feef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:35:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Volume volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 (41f53090-3fbb-42b9-acb2-05091a7fdae2): created successfully Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aaa363-6a65-49aa-8714-9849c1feef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:35:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Flow 'volume_create_manager' (9b3920ed-0f39-49b5-866f-deceb717b767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:35:58 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a69f665c-6020-4871-bce8-c121a4317d41 tempest-CreateVolumesFromImageTest-465615241 None] Created volume successfully. Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-41f53090-3fbb-42b9-acb2-05091a7fdae2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-41f53090-3fbb-42b9-acb2-05091a7fdae2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-quobyte-41f53090-3fbb-42b9-acb2-05091a7fdae2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-41f53090-3fbb-42b9-acb2-05091a7fdae2" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[68145f08-5c68-4955-b3e2-34a1c34bf54d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:35:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:35:59 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 Aug 04 12:35:59 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:00 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:00 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2 Aug 04 12:36:00 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:00 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41f53090-3fbb-42b9-acb2-05091a7fdae2" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-41f53090-3fbb-42b9-acb2-05091a7fdae2" released by "delete_volume" :: held 0.648s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Created reservations ['0b577d3a-4265-4231-a796-ca5a39b0245a', 'f5124aa7-6e43-4c01-9318-12241d935dd1', 'caddb364-d208-4a69-869e-0806334e5c23', 'ed97f296-5178-4d39-89b0-3a43ec1912ea'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:00 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:00 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:00 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Deleted volume successfully. Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-db156a51-dc8e-4ae5-bff5-2cec4be426c6 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-41f53090-3fbb-42b9-acb2-05091a7fdae2-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-b586887c-25ec-4e3e-8a1f-bf3ccb044449-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-b586887c-25ec-4e3e-8a1f-bf3ccb044449-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-quobyte-b586887c-25ec-4e3e-8a1f-bf3ccb044449" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-b586887c-25ec-4e3e-8a1f-bf3ccb044449" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d076ff-8d6e-4d72-b264-00fad6f16392]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:00 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 Aug 04 12:36:00 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:01 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449" returned: 0 in 0.340s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:01 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449 Aug 04 12:36:01 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:01 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-b586887c-25ec-4e3e-8a1f-bf3ccb044449" returned: 0 in 0.247s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-b586887c-25ec-4e3e-8a1f-bf3ccb044449" released by "delete_volume" :: held 0.626s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Created reservations ['967fe8cf-ebce-410e-9241-8b7f29adad9e', 'b1ed720f-d203-4edb-91aa-82fa126a1c0f', '029a25ed-e43b-49ec-b05b-45db95c69185', '48ed2af4-bf8f-4eb9-97b8-542e248504d9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:01 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:01 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:01 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.237s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Deleted volume successfully. Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83da5dba-8ddb-4647-801b-27b813de4b8e tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-b586887c-25ec-4e3e-8a1f-bf3ccb044449-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-29adeb8c-1c5a-4c19-a693-745f3dabc633-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-29adeb8c-1c5a-4c19-a693-745f3dabc633-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-quobyte-29adeb8c-1c5a-4c19-a693-745f3dabc633" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-29adeb8c-1c5a-4c19-a693-745f3dabc633" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b63101c-5ec0-4565-ac34-807ed496e628]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:02 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 Aug 04 12:36:02 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:02 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:02 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633 Aug 04 12:36:02 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:02 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-29adeb8c-1c5a-4c19-a693-745f3dabc633" returned: 0 in 0.240s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-29adeb8c-1c5a-4c19-a693-745f3dabc633" released by "delete_volume" :: held 0.636s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Created reservations ['6ba14118-c676-41d9-8b5b-d019a527f087', '5613d5cc-1b8c-436d-b9e7-b59925429b51', 'fcdfda0a-c6c9-4765-ac2e-fbd8e6e03d22', '1171b114-61cb-4c8f-ba46-eeb8af7e6d24'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:02 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:02 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:02 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.232s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Deleted volume successfully. Aug 04 12:36:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2188489d-a037-45ac-9f87-8704352e0d89 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-29adeb8c-1c5a-4c19-a693-745f3dabc633-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-quobyte-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" acquired by "delete_volume" :: waited 0.012s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d269f7-f539-47ab-9056-f8402185d843]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:03 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a Aug 04 12:36:03 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:03 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:03 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a Aug 04 12:36:03 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:03 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" returned: 0 in 0.236s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a" released by "delete_volume" :: held 0.614s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Created reservations ['56450ac9-e820-44d9-960f-8a686e8a8df7', 'd720fd42-0fd5-4471-8ccc-2a3cd3d2027a', '13cee5f8-8889-4cac-9d41-de63ca38947f', 'c06014af-d5c2-4e6b-b2eb-3f5664113539'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:03 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:03 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:04 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.231s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Deleted volume successfully. Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e614e52d-afe3-4491-8797-58462a04c104 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-4ea18aaf-3c86-4093-8f6c-e8b4bc44d11a-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-640518fd-f00b-4f92-a94e-424e50f4c025-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-640518fd-f00b-4f92-a94e-424e50f4c025-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "cinder-quobyte-640518fd-f00b-4f92-a94e-424e50f4c025" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-640518fd-f00b-4f92-a94e-424e50f4c025" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd59c4-9569-4584-a63f-11d569bfb33c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:04 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 Aug 04 12:36:04 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:04 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:04 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025 Aug 04 12:36:04 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:04 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-640518fd-f00b-4f92-a94e-424e50f4c025" returned: 0 in 0.236s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-quobyte-640518fd-f00b-4f92-a94e-424e50f4c025" released by "delete_volume" :: held 0.609s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Created reservations ['87eb3231-8cf4-445c-817f-cf277633ea05', '71a5ba1f-fadf-418c-a846-f1df54c732e2', '667dcf13-ae30-4fd9-9414-679176485030', '92dd262c-a4e4-4300-bdf4-e6dd56d3b4eb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:04 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:04 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:05 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.227s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:05 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Deleted volume successfully. Aug 04 12:36:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-885db0d6-78be-4531-b0e8-9d3d9002dde4 tempest-CreateVolumesFromImageTest-465615241 None] Lock "cinder-640518fd-f00b-4f92-a94e-424e50f4c025-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:06 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:06 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:06 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:36:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Flow 'volume_create_manager' (947b5047-1d8f-476b-a096-249453dea2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7434cb-7e5b-4ac9-853d-741b910fbb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7434cb-7e5b-4ac9-853d-741b910fbb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-293103653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad9ef6d9426459286505bc3b8a11af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:08Z,use_quota=True,user_id='158b21d24b8b4a358987cd41a2df2dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87841d0-4296-46fc-bb73-5aa46cdb5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87841d0-4296-46fc-bb73-5aa46cdb5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b82547-5d5b-4184-8916-aaeed3a39e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b82547-5d5b-4184-8916-aaeed3a39e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07', 'volume_name': 'volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b10f05-fe0a-4299-a687-4773b85faf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b10f05-fe0a-4299-a687-4773b85faf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db14493-167b-45b5-a36e-4addc8966f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Volume 96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07', 'volume_size': 1} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-293103653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad9ef6d9426459286505bc3b8a11af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:08Z,use_quota=True,user_id='158b21d24b8b4a358987cd41a2df2dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Creating volume 96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:08 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:08 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 1073741824 Aug 04 12:36:08 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:08 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 1073741824" returned: 0 in 0.403s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:08 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:08 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:08 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db14493-167b-45b5-a36e-4addc8966f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0e3bf4-db7c-4c0e-8b43-9b1fa9ab66b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:08 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Volume volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 (96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07): created successfully Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0e3bf4-db7c-4c0e-8b43-9b1fa9ab66b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Flow 'volume_create_manager' (947b5047-1d8f-476b-a096-249453dea2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0bbdb655-0502-4dab-a1bc-e4b283295c4d tempest-VolumeDependencyTests-265671667 None] Created volume successfully. Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Creating offline snapshot 1e7f9826-2d16-4927-b617-5e664096337f of volume 96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff5656e-57a0-4aed-9894-611cb4366e27]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:09 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:09 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:09 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.341s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:09 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f 1G Aug 04 12:36:09 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:09 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f 1G" returned: 0 in 0.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:09 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:09 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:10 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:10 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f is being set with open permissions: ugo+rw Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:10 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:10 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:10 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.236s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:10 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info Aug 04 12:36:10 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:10 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info" returned: 0 in 0.242s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:10 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info is being set with open permissions: ugo+rw Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:10 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info Aug 04 12:36:10 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:10 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.info" returned: 0 in 0.230s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a718d086-ba8e-49b8-b721-d44ab12c4802 tempest-VolumeDependencyTests-265671667 None] Create snapshot completed successfully Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Flow 'volume_create_manager' (f2b74deb-9aaf-46f9-a306-1ee3c0bf46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1578e70b-1f4d-4cb1-959b-8904254b712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1578e70b-1f4d-4cb1-959b-8904254b712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1022635808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2a4175-9772-4a3a-a026-8c7cfede14c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad9ef6d9426459286505bc3b8a11af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e7f9826-2d16-4927-b617-5e664096337f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:12Z,use_quota=True,user_id='158b21d24b8b4a358987cd41a2df2dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae0cade-46cc-4f83-9d4a-d901b20954c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae0cade-46cc-4f83-9d4a-d901b20954c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83962c2-b968-40bc-ba7f-6739984a7978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83962c2-b968-40bc-ba7f-6739984a7978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f2a4175-9772-4a3a-a026-8c7cfede14c8', 'volume_name': 'volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8', 'volume_size': 1, 'snapshot_id': '1e7f9826-2d16-4927-b617-5e664096337f'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ececc1-7a32-4090-a317-1a3bc998808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ececc1-7a32-4090-a317-1a3bc998808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfca12e-d2db-4a1d-8cc2-526b06309fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:11 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Volume 0f2a4175-9772-4a3a-a026-8c7cfede14c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8', 'volume_size': 1, 'snapshot_id': '1e7f9826-2d16-4927-b617-5e664096337f'} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f-0f2a4175-9772-4a3a-a026-8c7cfede14c8" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f-0f2a4175-9772-4a3a-a026-8c7cfede14c8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Creating volume 0f2a4175-9772-4a3a-a026-8c7cfede14c8 from snapshot 1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] snapshot: 1e7f9826-2d16-4927-b617-5e664096337f, volume: 0f2a4175-9772-4a3a-a026-8c7cfede14c8, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c051712-5ab2-4b12-b55b-3fa1383867c7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:12 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:12 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:12 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5169b42b-b97b-4e56-86c6-6e9183bf71f9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:12 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:12 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:12 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:36:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:12 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 Aug 04 12:36:12 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:16 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8" returned: 0 in 3.896s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07, size 1024.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:36:16 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Converted 1024.00 MB image at 262.66 MB/s Aug 04 12:36:16 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 is being set with open permissions: ugo+rw Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:16 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 Aug 04 12:36:16 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:16 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8" returned: 0 in 0.236s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" released by "_copy_volume_from_snapshot" :: held 4.918s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f-0f2a4175-9772-4a3a-a026-8c7cfede14c8" released by "_create_volume_from_snapshot" :: held 4.973s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.988s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfca12e-d2db-4a1d-8cc2-526b06309fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8', 'volume_size': 1, 'snapshot_id': '1e7f9826-2d16-4927-b617-5e664096337f'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f43192-969b-4d75-8fa3-2359a4cafe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Volume volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 (0f2a4175-9772-4a3a-a026-8c7cfede14c8): created successfully Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f43192-969b-4d75-8fa3-2359a4cafe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Flow 'volume_create_manager' (f2b74deb-9aaf-46f9-a306-1ee3c0bf46d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-055aaa8c-6a60-4153-b2ff-ca115843b76c tempest-VolumeDependencyTests-265671667 None] Created volume successfully. Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-1e7f9826-2d16-4927-b617-5e664096337f-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-1e7f9826-2d16-4927-b617-5e664096337f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Deleting offline snapshot 1e7f9826-2d16-4927-b617-5e664096337f of volume 96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] snapshot_file for this snap is: volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddb5f64-1fda-446e-848b-c64370a2e261]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:17 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:17 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:17 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d668bcf-eb77-40d1-8026-627788245e2a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:17 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:17 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:18 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.536s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:18 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:18 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:18 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:18 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f Aug 04 12:36:18 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:18 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07.1e7f9826-2d16-4927-b617-5e664096337f" returned: 0 in 0.236s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-1e7f9826-2d16-4927-b617-5e664096337f" released by "_delete_snapshot" :: held 1.556s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" released by "delete_snapshot" :: held 1.579s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Created reservations ['aab40464-ba83-473c-b136-81377bc6f22e', 'd28d39cc-f594-447e-9778-9007ce1b556c', 'f669fdc9-318e-4983-b871-69057433c556', '1fd07684-5303-4c0c-9df2-3286dcb071f4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:19 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Delete snapshot completed successfully. Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-683d37ad-15a7-46a3-9915-3ab8a850f926 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-1e7f9826-2d16-4927-b617-5e664096337f-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" acquired by "delete_volume" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8e4904-fa44-4f70-9fb8-c819579dc59a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:19 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:19 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:19 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.348s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:19 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07 Aug 04 12:36:19 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:20 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" returned: 0 in 0.237s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07" released by "delete_volume" :: held 0.638s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Created reservations ['c532b45f-87f8-4c62-894e-c5e5a4f8f741', 'b74a71a5-49df-4d03-8caf-c39b1804307d', 'f5b2101d-1b26-4583-9fec-dcbecd4964ca', '47d59af9-1f85-429d-9d14-8db003addc1e'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:20 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:20 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:20 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Deleted volume successfully. Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f6a1d647-1430-4d79-93e6-145209d5c7d8 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-96bc40ee-80a5-4c80-a5c4-c5f8ce01dc07-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-0f2a4175-9772-4a3a-a026-8c7cfede14c8-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-0f2a4175-9772-4a3a-a026-8c7cfede14c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb4ab9-ef1e-41f0-b09b-6e5e51a46967]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:20 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 Aug 04 12:36:20 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:21 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:21 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8 Aug 04 12:36:21 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:21 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-0f2a4175-9772-4a3a-a026-8c7cfede14c8" returned: 0 in 0.240s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-quobyte-0f2a4175-9772-4a3a-a026-8c7cfede14c8" released by "delete_volume" :: held 0.625s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Created reservations ['8e18b2a0-2e9b-45bd-af28-f2147a597523', 'bb054d30-3878-431e-9511-b9495ff724f9', '75c574c2-8219-4167-89db-0efa41af5470', '95d09e4c-ff74-4d25-a6c3-7727138a4839'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:21 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:21 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:21 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Deleted volume successfully. Aug 04 12:36:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1ce1fe91-3402-40ec-bbdb-169ee918e759 tempest-VolumeDependencyTests-265671667 None] Lock "cinder-0f2a4175-9772-4a3a-a026-8c7cfede14c8-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Flow 'volume_create_manager' (4b0e4d3e-26ba-43f4-9a2d-bb2a7d2f1e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a47f7e4-7e85-4e50-9b49-91ce3af7033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a47f7e4-7e85-4e50-9b49-91ce3af7033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8911356-c811-4bbb-81b5-042aa7bb8ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226be41bcc834a80b9a81df811fa4c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:24Z,use_quota=True,user_id='5d083f658f354b7993bf502dc899b37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361500fd-6479-4a81-9e80-68f0f4772af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361500fd-6479-4a81-9e80-68f0f4772af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5de0b5-2a02-4612-972d-f144877fcff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5de0b5-2a02-4612-972d-f144877fcff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8911356-c811-4bbb-81b5-042aa7bb8ff6', 'volume_name': 'volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f73d6c-edd6-40e6-b119-13b24fd909da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f73d6c-edd6-40e6-b119-13b24fd909da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477452d-057c-4c26-9311-40f92328cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Volume e8911356-c811-4bbb-81b5-042aa7bb8ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6', 'volume_size': 1} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8911356-c811-4bbb-81b5-042aa7bb8ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226be41bcc834a80b9a81df811fa4c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:24Z,use_quota=True,user_id='5d083f658f354b7993bf502dc899b37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Creating volume e8911356-c811-4bbb-81b5-042aa7bb8ff6 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:24 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:36:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:24 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 1073741824 Aug 04 12:36:24 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:25 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 1073741824" returned: 0 in 0.439s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:25 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 Aug 04 12:36:25 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:25 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477452d-057c-4c26-9311-40f92328cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deafc40d-7fd3-4ec3-a2da-3140db648c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:25 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Volume volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 (e8911356-c811-4bbb-81b5-042aa7bb8ff6): created successfully Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deafc40d-7fd3-4ec3-a2da-3140db648c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Flow 'volume_create_manager' (4b0e4d3e-26ba-43f4-9a2d-bb2a7d2f1e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d5465e47-9d56-4808-bbd6-e8412422dd98 tempest-CinderUnicodeTest-1715589841 None] Created volume successfully. Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Flow 'volume_create_manager' (52b6212f-3c06-4518-b37e-d14a1ba9271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a8e29-5a96-4e6c-b483-31f0a76ead98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a8e29-5a96-4e6c-b483-31f0a76ead98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349570211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d59496-81d7-4117-98ac-034c759cec47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226be41bcc834a80b9a81df811fa4c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:26Z,use_quota=True,user_id='5d083f658f354b7993bf502dc899b37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c6d61-7b26-4a2a-972e-73a432635f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785c6d61-7b26-4a2a-972e-73a432635f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da8172e-09b7-42b1-8e2d-5dc3a6333b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da8172e-09b7-42b1-8e2d-5dc3a6333b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d59496-81d7-4117-98ac-034c759cec47', 'volume_name': 'volume-33d59496-81d7-4117-98ac-034c759cec47', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c64d46e-3135-493a-a24c-5d84b792b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c64d46e-3135-493a-a24c-5d84b792b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3ab5d9-f76e-4ddf-b6f9-c8ecd55d5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Volume 33d59496-81d7-4117-98ac-034c759cec47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d59496-81d7-4117-98ac-034c759cec47', 'volume_size': 1} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-349570211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d59496-81d7-4117-98ac-034c759cec47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226be41bcc834a80b9a81df811fa4c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:26Z,use_quota=True,user_id='5d083f658f354b7993bf502dc899b37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Creating volume 33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:26 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:26 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 1073741824 Aug 04 12:36:26 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:26 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 1073741824" returned: 0 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:26 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 Aug 04 12:36:26 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:26 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3ab5d9-f76e-4ddf-b6f9-c8ecd55d5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d59496-81d7-4117-98ac-034c759cec47', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a571fb-ffe0-43a5-bafb-fd5b1b9ca808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Volume volume-33d59496-81d7-4117-98ac-034c759cec47 (33d59496-81d7-4117-98ac-034c759cec47): created successfully Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a571fb-ffe0-43a5-bafb-fd5b1b9ca808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Flow 'volume_create_manager' (52b6212f-3c06-4518-b37e-d14a1ba9271a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-97fb744f-215e-4166-b3a6-e3467c4bc565 tempest-CinderUnicodeTest-1715589841 None] Created volume successfully. Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Creating offline snapshot 642cee30-521e-4fd9-814d-080c11f3be7c of volume 33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8090b-daba-4335-ac85-ff8611e3865a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:27 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 Aug 04 12:36:27 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:27 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47" returned: 0 in 0.354s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:27 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c 1G Aug 04 12:36:27 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:28 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c 1G" returned: 0 in 0.374s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d59496-81d7-4117-98ac-034c759cec47 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:28 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d59496-81d7-4117-98ac-034c759cec47 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c Aug 04 12:36:28 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:28 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d59496-81d7-4117-98ac-034c759cec47 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c" returned: 0 in 0.303s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:28 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c is being set with open permissions: ugo+rw Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:28 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c Aug 04 12:36:28 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:28 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c" returned: 0 in 0.261s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:28 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info Aug 04 12:36:28 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:29 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:29 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info is being set with open permissions: ugo+rw Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:29 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info Aug 04 12:36:29 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:29 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.info" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6b4d4760-ea64-4129-acea-684b14428383 tempest-CinderUnicodeTest-1715589841 None] Create snapshot completed successfully Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-642cee30-521e-4fd9-814d-080c11f3be7c-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-642cee30-521e-4fd9-814d-080c11f3be7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-quobyte-642cee30-521e-4fd9-814d-080c11f3be7c" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-642cee30-521e-4fd9-814d-080c11f3be7c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Deleting offline snapshot 642cee30-521e-4fd9-814d-080c11f3be7c of volume 33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] snapshot_file for this snap is: volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba5d01-d8d3-45ec-972e-7e9fef6e6a2a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:29 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c Aug 04 12:36:29 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:29 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33d59496-81d7-4117-98ac-034c759cec47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032ef19-3b75-408a-a37e-3a6dcbe42c74]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:30 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 Aug 04 12:36:30 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:30 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47" returned: 0 in 0.344s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:30 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c Aug 04 12:36:30 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:30 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:30 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c Aug 04 12:36:30 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:30 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47.642cee30-521e-4fd9-814d-080c11f3be7c" returned: 0 in 0.240s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-642cee30-521e-4fd9-814d-080c11f3be7c" released by "_delete_snapshot" :: held 1.358s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" released by "delete_snapshot" :: held 1.380s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Created reservations ['4fe8c7c8-16bd-43c0-8643-16cb34e5ba67', '6c9b402f-6307-46e2-9496-a84d530f12a2', '693a8d8a-9bca-460c-9e8f-50202f07a136', '8f12286b-e4d3-4dc5-a17e-b2f2f2619523'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Delete snapshot completed successfully. Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bb838af-a842-4380-8666-451b4b973e94 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-642cee30-521e-4fd9-814d-080c11f3be7c-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-33d59496-81d7-4117-98ac-034c759cec47-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-33d59496-81d7-4117-98ac-034c759cec47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" acquired by "delete_volume" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d121cd97-b913-4940-8ce9-292b3560c3ed]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:31 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 Aug 04 12:36:31 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:32 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47" returned: 0 in 0.349s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:32 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47 Aug 04 12:36:32 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:32 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-33d59496-81d7-4117-98ac-034c759cec47" returned: 0 in 0.240s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-33d59496-81d7-4117-98ac-034c759cec47" released by "delete_volume" :: held 0.640s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Created reservations ['5c821945-211b-4571-bc65-5d4b69c000c5', 'c654c5c4-be47-44ca-bc48-19cc095ce9f0', '9f502850-6f0c-48a2-97a6-a19526500471', '0fd40654-2533-41fe-9931-c0c49f32a6c2'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:32 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:32 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:32 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Deleted volume successfully. Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b31fab7d-489b-472c-b852-fe6fe2164983 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-33d59496-81d7-4117-98ac-034c759cec47-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-e8911356-c811-4bbb-81b5-042aa7bb8ff6-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-e8911356-c811-4bbb-81b5-042aa7bb8ff6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "cinder-quobyte-e8911356-c811-4bbb-81b5-042aa7bb8ff6" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-e8911356-c811-4bbb-81b5-042aa7bb8ff6" acquired by "delete_volume" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5d997-0809-481e-b5c8-0a24363928c6]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:33 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 Aug 04 12:36:33 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:33 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:33 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6 Aug 04 12:36:33 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:33 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-e8911356-c811-4bbb-81b5-042aa7bb8ff6" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-quobyte-e8911356-c811-4bbb-81b5-042aa7bb8ff6" released by "delete_volume" :: held 0.613s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Created reservations ['d66270c1-0e81-4aad-9c47-8e0f971840a7', '23d633f3-55bb-4653-ba44-05b4132794dc', '44293223-7056-4b8c-86ce-a29c89be7279', '61c53a1d-05eb-4d7a-b410-6e83d471f9df'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:33 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:36:33 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:33 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:36:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Deleted volume successfully. Aug 04 12:36:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30e9653f-891a-4885-bfa9-ecfba10f11d1 tempest-CinderUnicodeTest-1715589841 None] Lock "cinder-e8911356-c811-4bbb-81b5-042aa7bb8ff6-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:36:43 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=119,cinder:SELECT=83,cinder:INSERT=39,cinder:DELETE=14 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:36:43 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=109,cinder:INSERT=31,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Flow 'volume_create_manager' (d912194b-1cd5-4f92-8106-b02da8a548c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb01ba-8543-4bcd-a972-7100f018e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb01ba-8543-4bcd-a972-7100f018e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-178570939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a24d747-8e51-4622-805a-a00c7847b5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5939c6d29c7846978d1ba0f95af72e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:52Z,use_quota=True,user_id='896f43856bcf44c2b04f7169a5ca8677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa0bae2-d8ef-4669-9348-22f2b7c5dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa0bae2-d8ef-4669-9348-22f2b7c5dd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b6732e-9bd7-4331-9945-3126b8613f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b6732e-9bd7-4331-9945-3126b8613f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a24d747-8e51-4622-805a-a00c7847b5d6', 'volume_name': 'volume-2a24d747-8e51-4622-805a-a00c7847b5d6', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36538ec3-054a-4dd7-a214-f88452a20009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36538ec3-054a-4dd7-a214-f88452a20009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4516f7-1b84-4c62-b0cc-e048ac4b9892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Volume 2a24d747-8e51-4622-805a-a00c7847b5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a24d747-8e51-4622-805a-a00c7847b5d6', 'volume_size': 1} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-178570939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a24d747-8e51-4622-805a-a00c7847b5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5939c6d29c7846978d1ba0f95af72e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:52Z,use_quota=True,user_id='896f43856bcf44c2b04f7169a5ca8677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Creating volume 2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:52 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:52 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 1073741824 Aug 04 12:36:52 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:52 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 1073741824" returned: 0 in 0.398s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:52 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:36:52 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:52 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.232s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4516f7-1b84-4c62-b0cc-e048ac4b9892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a24d747-8e51-4622-805a-a00c7847b5d6', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecda365-02b2-4b98-823b-577f028bf63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Volume volume-2a24d747-8e51-4622-805a-a00c7847b5d6 (2a24d747-8e51-4622-805a-a00c7847b5d6): created successfully Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecda365-02b2-4b98-823b-577f028bf63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Flow 'volume_create_manager' (d912194b-1cd5-4f92-8106-b02da8a548c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a010cf3c-b84c-44e0-a0fe-d9d69d7ae641 tempest-SnapshotDependencyTests-1653303585 None] Created volume successfully. Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Creating offline snapshot b7aa4520-4a87-4e50-a942-e6e0beb798fa of volume 2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9849037-78e8-470c-9c3f-b639cdfa10fb]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:53 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:36:53 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:53 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.339s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:53 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa 1G Aug 04 12:36:53 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:54 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa 1G" returned: 0 in 0.373s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a24d747-8e51-4622-805a-a00c7847b5d6 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:54 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a24d747-8e51-4622-805a-a00c7847b5d6 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:36:54 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:54 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a24d747-8e51-4622-805a-a00c7847b5d6 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:54 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa is being set with open permissions: ugo+rw Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:54 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:36:54 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:54 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.229s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:54 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info Aug 04 12:36:54 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:54 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:54 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info is being set with open permissions: ugo+rw Aug 04 12:36:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:54 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info Aug 04 12:36:54 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:55 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.info" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8224becd-e434-4d04-bea9-f095606eb2d3 tempest-SnapshotDependencyTests-1653303585 None] Create snapshot completed successfully Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Flow 'volume_create_manager' (47c0fdd6-829c-4064-8426-664b11defa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4dac23-7bcd-470e-801b-2d53cb83b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4dac23-7bcd-470e-801b-2d53cb83b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66071381-9f49-4eb0-96cd-f5cdf163b5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5939c6d29c7846978d1ba0f95af72e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7aa4520-4a87-4e50-a942-e6e0beb798fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:36:56Z,use_quota=True,user_id='896f43856bcf44c2b04f7169a5ca8677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e290345a-5add-4415-88e0-1da4854a3d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e290345a-5add-4415-88e0-1da4854a3d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe173759-418c-4d34-8b54-c92e003300c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe173759-418c-4d34-8b54-c92e003300c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66071381-9f49-4eb0-96cd-f5cdf163b5c5', 'volume_name': 'volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5', 'volume_size': 1, 'snapshot_id': 'b7aa4520-4a87-4e50-a942-e6e0beb798fa'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690c945-3ef8-40c9-912f-4b4c23087d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690c945-3ef8-40c9-912f-4b4c23087d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371147a3-c5fa-48d3-841f-942ccc50800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:36:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Volume 66071381-9f49-4eb0-96cd-f5cdf163b5c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5', 'volume_size': 1, 'snapshot_id': 'b7aa4520-4a87-4e50-a942-e6e0beb798fa'} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa-66071381-9f49-4eb0-96cd-f5cdf163b5c5" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa-66071381-9f49-4eb0-96cd-f5cdf163b5c5" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Creating volume 66071381-9f49-4eb0-96cd-f5cdf163b5c5 from snapshot b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] snapshot: b7aa4520-4a87-4e50-a942-e6e0beb798fa, volume: 66071381-9f49-4eb0-96cd-f5cdf163b5c5, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab9ac8e-ff49-4657-a447-e476fedfff42]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:56 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:36:56 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:56 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.353s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a24d747-8e51-4622-805a-a00c7847b5d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0d0c79-e138-4a6f-bb2f-78ad90df0c47]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:56 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:36:56 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:36:56 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:36:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:36:56 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 Aug 04 12:36:56 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:00 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5" returned: 0 in 3.984s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:00 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:37:00 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Converted 1024.00 MB image at 256.96 MB/s Aug 04 12:37:00 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 is being set with open permissions: ugo+rw Aug 04 12:37:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:00 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 Aug 04 12:37:00 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:01 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" released by "_copy_volume_from_snapshot" :: held 4.990s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa-66071381-9f49-4eb0-96cd-f5cdf163b5c5" released by "_create_volume_from_snapshot" :: held 5.147s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.161s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371147a3-c5fa-48d3-841f-942ccc50800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5', 'volume_size': 1, 'snapshot_id': 'b7aa4520-4a87-4e50-a942-e6e0beb798fa'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dc4ac-23e1-4688-a008-0e8c3c4fbecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Volume volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 (66071381-9f49-4eb0-96cd-f5cdf163b5c5): created successfully Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dc4ac-23e1-4688-a008-0e8c3c4fbecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Flow 'volume_create_manager' (47c0fdd6-829c-4064-8426-664b11defa4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a64688c8-2d68-45a8-a5b9-3ac0d557913a tempest-SnapshotDependencyTests-1653303585 None] Created volume successfully. Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-b7aa4520-4a87-4e50-a942-e6e0beb798fa-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-b7aa4520-4a87-4e50-a942-e6e0beb798fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Deleting offline snapshot b7aa4520-4a87-4e50-a942-e6e0beb798fa of volume 2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] snapshot_file for this snap is: volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce58d85e-938b-456d-ad65-cc9a0ecc94d0]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:01 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:37:01 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:02 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a24d747-8e51-4622-805a-a00c7847b5d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c29743-33e9-44be-a82e-d98aa67e30fd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:02 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:37:02 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:02 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.555s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:02 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:37:02 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:02 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:02 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa Aug 04 12:37:02 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:03 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6.b7aa4520-4a87-4e50-a942-e6e0beb798fa" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-b7aa4520-4a87-4e50-a942-e6e0beb798fa" released by "_delete_snapshot" :: held 1.591s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" released by "delete_snapshot" :: held 1.614s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Created reservations ['ef6b6b4c-6e2c-43ea-bf15-0cfaa6237d64', '5496d423-19dd-464c-ba2a-f34bb0157529', '633cdb39-8c5f-41e4-9432-aaa18155c669', '6802194d-4e09-413d-b59b-5a8daeb98fd9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Delete snapshot completed successfully. Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a43bb237-a824-47a7-ad7d-e07c66f495ee tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-b7aa4520-4a87-4e50-a942-e6e0beb798fa-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-2a24d747-8e51-4622-805a-a00c7847b5d6-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-2a24d747-8e51-4622-805a-a00c7847b5d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[669166df-8bf2-4372-8bb7-e577077d981b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:03 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:37:03 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:04 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:04 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6 Aug 04 12:37:04 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:04 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2a24d747-8e51-4622-805a-a00c7847b5d6" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-2a24d747-8e51-4622-805a-a00c7847b5d6" released by "delete_volume" :: held 0.645s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Created reservations ['474d0b43-c739-4549-8ddc-98cf0ebdc8dd', 'a15d20bd-fc5a-4567-a7e2-4a435764c7b9', '9e75f140-ab41-4492-b9dc-995216d3de76', '981f7e30-4f5e-4427-a2c4-7268d6e9dd46'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:04 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:04 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:04 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Deleted volume successfully. Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-905d23f6-328f-4917-9116-e65e154e624e tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-2a24d747-8e51-4622-805a-a00c7847b5d6-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-66071381-9f49-4eb0-96cd-f5cdf163b5c5-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-66071381-9f49-4eb0-96cd-f5cdf163b5c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c577681-842d-46a8-ac0f-e9b6f2d2b2c1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:05 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 Aug 04 12:37:05 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:05 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5" returned: 0 in 0.354s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:05 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5 Aug 04 12:37:05 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:05 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-66071381-9f49-4eb0-96cd-f5cdf163b5c5" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-quobyte-66071381-9f49-4eb0-96cd-f5cdf163b5c5" released by "delete_volume" :: held 0.638s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Created reservations ['c1aa7060-d0be-4150-bd70-c3440f44e14f', '9a0cd9f0-3255-4e73-97cc-ad6c4347bb28', '1765dfa9-2629-4655-9104-d8b80a7343f7', '89da214b-121e-4e8d-ae91-d8f49843e8b9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:05 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:05 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:05 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Deleted volume successfully. Aug 04 12:37:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-66708c78-69d8-4954-b590-7e9bb638575c tempest-SnapshotDependencyTests-1653303585 None] Lock "cinder-66071381-9f49-4eb0-96cd-f5cdf163b5c5-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:06 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:06 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:06 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:37:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:37:15 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=35,cinder:SELECT=18,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:37:15 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=31,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (ac83bacd-ca56-43c2-adb3-aaca5819de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc084c93-ce24-4add-abf2-18ea0ec76553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc084c93-ce24-4add-abf2-18ea0ec76553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689475429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4857f-a7cb-48bf-845d-5c2c2a38bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:24Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2bbef4-70ee-4b9c-94a2-ac0fe16ba8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2bbef4-70ee-4b9c-94a2-ac0fe16ba8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72ea205-957b-40bd-a6a8-fdb7f0228bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72ea205-957b-40bd-a6a8-fdb7f0228bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb4857f-a7cb-48bf-845d-5c2c2a38bc22', 'volume_name': 'volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa34c1e-cba4-46be-b13e-46d143c81a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa34c1e-cba4-46be-b13e-46d143c81a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8ce02-6006-4577-8ffe-192f575020dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume 9eb4857f-a7cb-48bf-845d-5c2c2a38bc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22', 'volume_size': 1} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689475429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4857f-a7cb-48bf-845d-5c2c2a38bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:24Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume 9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:24 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:24 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 1073741824 Aug 04 12:37:24 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Flow 'volume_create_manager' (f21ef63e-5a58-4d03-a121-328be02d88dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3720b4-1826-42d7-909b-c1d2584b1545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3720b4-1826-42d7-909b-c1d2584b1545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502276382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbeb990-4ca0-412c-9873-016e5e23f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7fbd29d9b4cf8bded574c51e3ec5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:25Z,use_quota=True,user_id='536a8caf50394016a7783523e5e95fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b254150d-a41f-4bfa-95a5-101a2dd4789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b254150d-a41f-4bfa-95a5-101a2dd4789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00bb87a-9975-49bf-a2e9-e8a86c7f1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00bb87a-9975-49bf-a2e9-e8a86c7f1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbeb990-4ca0-412c-9873-016e5e23f951', 'volume_name': 'volume-2bbeb990-4ca0-412c-9873-016e5e23f951', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a857cea5-8197-41fc-a3de-65ec36438cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a857cea5-8197-41fc-a3de-65ec36438cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b7046b-3dfc-420e-beba-eb3c986affea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Volume 2bbeb990-4ca0-412c-9873-016e5e23f951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbeb990-4ca0-412c-9873-016e5e23f951', 'volume_size': 1} Aug 04 12:37:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:25 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 1073741824" returned: 0 in 0.677s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:25 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 Aug 04 12:37:25 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (be417fbe-9144-4941-be59-3c88f51e2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde3cf1-dd5c-413a-b4ea-0060a5d1bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde3cf1-dd5c-413a-b4ea-0060a5d1bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609110642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fec92b-142a-4324-8571-b85aa8bb1b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:25Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c5ff6f-c320-47e4-b708-2699d45897c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c5ff6f-c320-47e4-b708-2699d45897c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb40848-78c0-4c1a-9e5a-a6d67cce5c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb40848-78c0-4c1a-9e5a-a6d67cce5c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fec92b-142a-4324-8571-b85aa8bb1b96', 'volume_name': 'volume-c5fec92b-142a-4324-8571-b85aa8bb1b96', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a6a3c1-0f4f-4110-a4b1-da9756f8d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a6a3c1-0f4f-4110-a4b1-da9756f8d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af990a9-21c7-4da4-bba6-2ce2755cc8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume c5fec92b-142a-4324-8571-b85aa8bb1b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fec92b-142a-4324-8571-b85aa8bb1b96', 'volume_size': 1} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:25 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502276382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbeb990-4ca0-412c-9873-016e5e23f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7fbd29d9b4cf8bded574c51e3ec5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:25Z,use_quota=True,user_id='536a8caf50394016a7783523e5e95fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Creating volume 2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:25 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:25 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 1073741824 Aug 04 12:37:25 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8ce02-6006-4577-8ffe-192f575020dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccfebb0-f7fb-49ac-b184-83f69e563a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:25 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 (9eb4857f-a7cb-48bf-845d-5c2c2a38bc22): created successfully Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccfebb0-f7fb-49ac-b184-83f69e563a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (ac83bacd-ca56-43c2-adb3-aaca5819de32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-efeaa80f-330f-4ae5-ab25-cc5bf3f6655d tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:26 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 1073741824" returned: 0 in 0.519s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:26 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:26 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:26 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609110642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fec92b-142a-4324-8571-b85aa8bb1b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:25Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume c5fec92b-142a-4324-8571-b85aa8bb1b96 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:26 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b7046b-3dfc-420e-beba-eb3c986affea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbeb990-4ca0-412c-9873-016e5e23f951', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a4f6c2-5abd-4b8f-a07e-d5f63d2b116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:26 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 1073741824 Aug 04 12:37:26 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Volume volume-2bbeb990-4ca0-412c-9873-016e5e23f951 (2bbeb990-4ca0-412c-9873-016e5e23f951): created successfully Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a4f6c2-5abd-4b8f-a07e-d5f63d2b116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Flow 'volume_create_manager' (f21ef63e-5a58-4d03-a121-328be02d88dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-84d296e1-da0c-4b4e-86e6-dc61528d879a tempest-VolumeDependencyTests-932339492 None] Created volume successfully. Aug 04 12:37:26 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 1073741824" returned: 0 in 0.438s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:26 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 Aug 04 12:37:26 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:27 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96" returned: 0 in 0.281s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.138s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating offline snapshot bd237b26-d15f-4c27-bfea-d985ca262dd8 of volume 9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af990a9-21c7-4da4-bba6-2ce2755cc8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fec92b-142a-4324-8571-b85aa8bb1b96', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffa7b51-7992-4761-be55-e4fe401a4b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf179c-e644-40da-a739-0ef7c49d1b71]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 (c5fec92b-142a-4324-8571-b85aa8bb1b96): created successfully Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffa7b51-7992-4761-be55-e4fe401a4b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (be417fbe-9144-4941-be59-3c88f51e2c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c5fb5c73-5238-4482-a818-97fb407dacd4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:27 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 Aug 04 12:37:27 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:27 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" returned: 0 in 0.395s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:27 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 1G Aug 04 12:37:27 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (eca8d551-7837-4df1-b6b7-e5f244f77518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba3262-26d3-4917-a6c6-929c34e92312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba3262-26d3-4917-a6c6-929c34e92312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2081272266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd2d719-37e1-45ae-9278-c72346863523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:28Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7001e2-3182-4072-8b2b-691aecd5c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7001e2-3182-4072-8b2b-691aecd5c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7964ffba-440c-4571-a847-a91a51b11561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7964ffba-440c-4571-a847-a91a51b11561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd2d719-37e1-45ae-9278-c72346863523', 'volume_name': 'volume-2fd2d719-37e1-45ae-9278-c72346863523', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7416b27-6bf8-4caa-baae-dda9c9342ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7416b27-6bf8-4caa-baae-dda9c9342ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174e1bd-9abf-4125-b5b8-37bc26763107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume 2fd2d719-37e1-45ae-9278-c72346863523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd2d719-37e1-45ae-9278-c72346863523', 'volume_size': 1} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:28 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 1G" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:28 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 Aug 04 12:37:28 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (3d4e0a65-b141-4828-bce9-5fdd777b1565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae58b7d-485c-4503-9f4a-a5f3840d842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae58b7d-485c-4503-9f4a-a5f3840d842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142800456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:28Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016ac1cd-f982-4d36-b371-fd9d89a1a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016ac1cd-f982-4d36-b371-fd9d89a1a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f1750-5cd6-4e10-8f31-484b2f28c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f1750-5cd6-4e10-8f31-484b2f28c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d', 'volume_name': 'volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d56dfa0-ffe7-4e1e-a93e-32ff82938e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d56dfa0-ffe7-4e1e-a93e-32ff82938e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a994c058-bc57-496a-8df8-c229eabbf5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume 3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d', 'volume_size': 1} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8" returned: 0 in 0.423s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:28 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 is being set with open permissions: ugo+rw Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:28 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 Aug 04 12:37:28 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Flow 'volume_create_manager' (befdd4fc-79e0-4d97-813a-52b35eadc4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7906c1-052c-48e3-984f-be28f95f1df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7906c1-052c-48e3-984f-be28f95f1df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a62896-ab4b-4671-8d4b-38f5109410e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f7969e928b4ff0bacf3e69738a2a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='0f6aa8ee20cb4b98b4e3ecd4717c8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea718408-ab35-4112-8996-7e0083ccc4ae),volume_type_id=ea718408-ab35-4112-8996-7e0083ccc4ae)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0175f2f8-9f37-4b24-b9aa-ca824cbd8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0175f2f8-9f37-4b24-b9aa-ca824cbd8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f5c2ff-43f6-421c-b7ce-6b6797e7c18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (0ee70bac-3938-4496-b2d9-375a23398614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:28 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e502c01c-7b02-4e49-b6f3-b51c8f50dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e502c01c-7b02-4e49-b6f3-b51c8f50dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425158607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829b1024-89cd-4810-917e-a835a0b2cbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088c5149-35f0-4c35-b904-9ccf9864844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088c5149-35f0-4c35-b904-9ccf9864844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035faf3-d316-4f29-96a5-54932b470636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035faf3-d316-4f29-96a5-54932b470636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829b1024-89cd-4810-917e-a835a0b2cbb0', 'volume_name': 'volume-829b1024-89cd-4810-917e-a835a0b2cbb0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871a9ac6-8d07-4c34-83c9-2b1c8d351388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871a9ac6-8d07-4c34-83c9-2b1c8d351388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad7c967-dafd-4cd5-b435-cfb7a0e29ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume 829b1024-89cd-4810-917e-a835a0b2cbb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829b1024-89cd-4810-917e-a835a0b2cbb0', 'volume_size': 1} Aug 04 12:37:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:29 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info Aug 04 12:37:29 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (749dcceb-a4d3-481d-a9f9-e64f554a4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d736f02-454e-43d8-8aec-67a81ba6708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d736f02-454e-43d8-8aec-67a81ba6708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315200106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9bf5a8-47ad-4c33-ad3f-050202faa6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9bf5a8-47ad-4c33-ad3f-050202faa6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b34ee6-457e-453f-b92c-aca8dd431da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b34ee6-457e-453f-b92c-aca8dd431da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc', 'volume_name': 'volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be9522e-b3f1-4843-826e-165ac45adcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be9522e-b3f1-4843-826e-165ac45adcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4835ba43-ce26-41d9-a8c1-00d28ccbaa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc', 'volume_size': 1} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f5c2ff-43f6-421c-b7ce-6b6797e7c18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0a62896-ab4b-4671-8d4b-38f5109410e1', 'volume_name': 'volume-d0a62896-ab4b-4671-8d4b-38f5109410e1', 'volume_size': 1, 'image_id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a8c8c331307fae610f3aff3bffcb045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f7969e928b4ff0bacf3e69738a2a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '09b65357c8faecbe88ffeecb8b78b6b734ba798f00226ce5ba18fd4e1587e3e3e37f1e2d7728f17636f984e9317481c3592404f1a9329f0421a2878a93679a96', 'id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'created_at': datetime.datetime(2026, 8, 4, 10, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 37, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2107867e-0527-4837-8961-92a25eaaa0e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b306de-eb42-4254-9e30-564412b55393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b306de-eb42-4254-9e30-564412b55393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1891b9-e320-44c8-b987-a99f065d197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Volume d0a62896-ab4b-4671-8d4b-38f5109410e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0a62896-ab4b-4671-8d4b-38f5109410e1', 'volume_size': 1, 'image_id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a8c8c331307fae610f3aff3bffcb045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f7969e928b4ff0bacf3e69738a2a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '09b65357c8faecbe88ffeecb8b78b6b734ba798f00226ce5ba18fd4e1587e3e3e37f1e2d7728f17636f984e9317481c3592404f1a9329f0421a2878a93679a96', 'id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'created_at': datetime.datetime(2026, 8, 4, 10, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 37, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2107867e-0527-4837-8961-92a25eaaa0e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Trying to clone d0a62896-ab4b-4671-8d4b-38f5109410e1 from image 2107867e-0527-4837-8961-92a25eaaa0e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:37:29 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info" returned: 0 in 0.312s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:29 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info is being set with open permissions: ugo+rw Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:29 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info Aug 04 12:37:29 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:37:29 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Image download 0.00 MB at 0.00 MB/s Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb5faa2-0d54-4f39-a829-1a9f9ecaa7ce]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:29 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:29 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:29 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (73f99585-4737-4917-a48b-309b9001835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b4102a-cb01-46ba-9121-39b47b2a2b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.info" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.579s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b4102a-cb01-46ba-9121-39b47b2a2b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110316812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03a3b9b-7652-47da-8a9d-5167fe84bf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:30Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2bcf40-f188-45fd-8156-ac57bb0408b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2bcf40-f188-45fd-8156-ac57bb0408b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d915a1b-86dd-4e6f-b45e-189ed4e9bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d915a1b-86dd-4e6f-b45e-189ed4e9bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03a3b9b-7652-47da-8a9d-5167fe84bf90', 'volume_name': 'volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4630036-fbbd-480f-9a59-b914ca9c05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4630036-fbbd-480f-9a59-b914ca9c05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58705a1e-1050-4845-bc52-37e4ceeac54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:29 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume a03a3b9b-7652-47da-8a9d-5167fe84bf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90', 'volume_size': 1} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Creating offline snapshot f22fe655-160c-4e50-86d6-eff2163d14d5 of volume 2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:37:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-11837ca7-2915-4140-b2be-fafc00ef5916 tempest-CreateVolumesFromSnapshotTest-339292471 None] Create snapshot completed successfully Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e09fc-a8a7-42c0-83e8-0fba6e692ed8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:29 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:29 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:29 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:29 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:29 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:30 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.352s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:30 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 1G Aug 04 12:37:30 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:30 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Temporary image 2107867e-0527-4837-8961-92a25eaaa0e3 is fetched for user 0f6aa8ee20cb4b98b4e3ecd4717c8b85. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6cb42d-03fe-4641-b9fd-e1520d3b423b]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:30 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:30 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:30 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 1G" returned: 0 in 0.505s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bbeb990-4ca0-412c-9873-016e5e23f951 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:30 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bbeb990-4ca0-412c-9873-016e5e23f951 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:30 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:30 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:30 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:30 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (91bfb579-1915-48d5-9e25-93167e727424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6218d7e0-0aa6-4ca3-935b-f3c498d0550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6218d7e0-0aa6-4ca3-935b-f3c498d0550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-522798464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695855b7-dc3a-4c65-ac31-97e14e0f65a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:31Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e0bbb8-a36c-4740-ac83-7447017bd07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e0bbb8-a36c-4740-ac83-7447017bd07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab016a53-a7dc-4279-9296-a3670c9d5a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab016a53-a7dc-4279-9296-a3670c9d5a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695855b7-dc3a-4c65-ac31-97e14e0f65a0', 'volume_name': 'volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d936b7a3-95bc-4f01-85fe-f8bea5ae1f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d936b7a3-95bc-4f01-85fe-f8bea5ae1f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc45f15b-e501-4a5a-8809-6fac75bb387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:30 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume 695855b7-dc3a-4c65-ac31-97e14e0f65a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0', 'volume_size': 1} Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:30 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bbeb990-4ca0-412c-9873-016e5e23f951 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.375s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:30 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 is being set with open permissions: ugo+rw Aug 04 12:37:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:30 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:30 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:31 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:31 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.285s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (c9dd1438-d542-4807-93b9-f1d3e9565dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119854ed-2d8c-4646-9e8d-a8b420d740e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119854ed-2d8c-4646-9e8d-a8b420d740e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315651109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a456615-736e-4058-bafb-89c44b804af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:31Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec4ffe-6d93-4f65-8763-8e82e9686224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec4ffe-6d93-4f65-8763-8e82e9686224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info Aug 04 12:37:31 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9b539f-b72e-4470-b1e4-131cf6e9f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9b539f-b72e-4470-b1e4-131cf6e9f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a456615-736e-4058-bafb-89c44b804af7', 'volume_name': 'volume-1a456615-736e-4058-bafb-89c44b804af7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72755d6-282d-4db2-b484-105340ab604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72755d6-282d-4db2-b484-105340ab604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26adec04-c93e-4da2-8bc2-abf804865a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume 1a456615-736e-4058-bafb-89c44b804af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a456615-736e-4058-bafb-89c44b804af7', 'volume_size': 1} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:31 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info" returned: 0 in 0.300s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:31 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info is being set with open permissions: ugo+rw Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:31 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info Aug 04 12:37:31 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (548dab08-098b-44a8-a43b-4476eb5b20f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b6084-d6cd-46e3-8098-4a6f31fcfe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b6084-d6cd-46e3-8098-4a6f31fcfe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682804366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffff359e-2abe-4d25-8802-d5e9899b88b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303e1f90-2cfe-4ad7-b513-436e8ff486ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303e1f90-2cfe-4ad7-b513-436e8ff486ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e311031-3af5-4973-95c1-301199d05bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e311031-3af5-4973-95c1-301199d05bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffff359e-2abe-4d25-8802-d5e9899b88b4', 'volume_name': 'volume-ffff359e-2abe-4d25-8802-d5e9899b88b4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe030bf-46b2-42e1-9994-cb79e10332ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe030bf-46b2-42e1-9994-cb79e10332ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd101865-2dcf-4e20-b525-49401f5ef3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume ffff359e-2abe-4d25-8802-d5e9899b88b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffff359e-2abe-4d25-8802-d5e9899b88b4', 'volume_size': 1} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:31 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.info" returned: 0 in 0.281s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.890s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2081272266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd2d719-37e1-45ae-9278-c72346863523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:28Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume 2fd2d719-37e1-45ae-9278-c72346863523 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:31 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:31 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 1073741824 Aug 04 12:37:31 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (34a57eb2-db38-456e-b80b-9e26f8439905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4867defd-7dea-4d76-9725-c2e28fd2a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ddb3974d-4acb-4c5e-82aa-7cd48e96b210 tempest-VolumeDependencyTests-932339492 None] Create snapshot completed successfully Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4867defd-7dea-4d76-9725-c2e28fd2a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585135269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c78c7c-c9d6-4221-a4e2-2913bc6f6566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418b23b-678b-4e82-bdd0-52502037a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418b23b-678b-4e82-bdd0-52502037a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32478a7-02d5-4719-abd7-fd8247fdc6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32478a7-02d5-4719-abd7-fd8247fdc6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c78c7c-c9d6-4221-a4e2-2913bc6f6566', 'volume_name': 'volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbd23bd-ee32-4885-bfd7-d534c70dde6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbd23bd-ee32-4885-bfd7-d534c70dde6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5f055-3252-4644-85a6-825fa583458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume 84c78c7c-c9d6-4221-a4e2-2913bc6f6566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566', 'volume_size': 1} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (21134e25-641c-49fe-9b0a-07f586282e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88fae64-3a84-495d-8caa-15fd7863f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88fae64-3a84-495d-8caa-15fd7863f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414357070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606ae606-7422-4279-9ec6-dbd1279b5bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199b983b-320a-414d-a330-e5ff419f07ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199b983b-320a-414d-a330-e5ff419f07ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66f74ff-66eb-4142-8a62-355b68a6f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66f74ff-66eb-4142-8a62-355b68a6f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606ae606-7422-4279-9ec6-dbd1279b5bdb', 'volume_name': 'volume-606ae606-7422-4279-9ec6-dbd1279b5bdb', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67457065-daab-424b-84cc-579854aec39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67457065-daab-424b-84cc-579854aec39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ef26a5-459d-43c5-b433-b0c1c0644db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume 606ae606-7422-4279-9ec6-dbd1279b5bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606ae606-7422-4279-9ec6-dbd1279b5bdb', 'volume_size': 1} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:32 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 1073741824" returned: 0 in 0.515s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:32 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 Aug 04 12:37:32 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:32 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523" returned: 0 in 0.253s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.160s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142800456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:28Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume 3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174e1bd-9abf-4125-b5b8-37bc26763107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd2d719-37e1-45ae-9278-c72346863523', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d 1073741824 Aug 04 12:37:32 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d7921f-267e-48eb-a863-f8f71e4c4cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-2fd2d719-37e1-45ae-9278-c72346863523 (2fd2d719-37e1-45ae-9278-c72346863523): created successfully Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d7921f-267e-48eb-a863-f8f71e4c4cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (eca8d551-7837-4df1-b6b7-e5f244f77518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0440521d-dd6d-4b4d-800e-4f2e33592b0d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:33 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d 1073741824" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Flow 'volume_create_manager' (f30c8435-5713-44ef-8241-af030caa0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b660966d-a9e4-40e0-872d-f1067ab5591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b660966d-a9e4-40e0-872d-f1067ab5591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-262123668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9662f897-2f55-45b3-b936-bf0cb70c8fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b7fbd29d9b4cf8bded574c51e3ec5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f22fe655-160c-4e50-86d6-eff2163d14d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:33Z,use_quota=True,user_id='536a8caf50394016a7783523e5e95fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8c773-f032-4d76-8912-927e8540d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8c773-f032-4d76-8912-927e8540d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca4048-e5d4-47d3-b620-bb7fbfa8a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca4048-e5d4-47d3-b620-bb7fbfa8a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9662f897-2f55-45b3-b936-bf0cb70c8fdb', 'volume_name': 'volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb', 'volume_size': 1, 'snapshot_id': 'f22fe655-160c-4e50-86d6-eff2163d14d5'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a39eba-d77d-457e-8680-9f9aa5624779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a39eba-d77d-457e-8680-9f9aa5624779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df0e0cf-617c-4ff3-aed3-e8fe2aa7d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Volume 9662f897-2f55-45b3-b936-bf0cb70c8fdb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb', 'volume_size': 1, 'snapshot_id': 'f22fe655-160c-4e50-86d6-eff2163d14d5'} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:33 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d Aug 04 12:37:33 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:33 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.611s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425158607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829b1024-89cd-4810-917e-a835a0b2cbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume 829b1024-89cd-4810-917e-a835a0b2cbb0 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:33 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:33 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 1073741824 Aug 04 12:37:33 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a994c058-bc57-496a-8df8-c229eabbf5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ec0f9-8e3d-46cb-a0e1-44b99c47f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d (3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d): created successfully Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ec0f9-8e3d-46cb-a0e1-44b99c47f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (3d4e0a65-b141-4828-bce9-5fdd777b1565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-13e2d15e-08d3-4c04-a07c-021a648265dc tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:34 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 1073741824" returned: 0 in 0.406s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:34 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 Aug 04 12:37:34 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:34 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.041s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315200106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:34 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad7c967-dafd-4cd5-b435-cfb7a0e29ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829b1024-89cd-4810-917e-a835a0b2cbb0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:34 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc 1073741824 Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2220c56-ab42-41e7-8cab-835ec12a121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:34 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:34 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-829b1024-89cd-4810-917e-a835a0b2cbb0 (829b1024-89cd-4810-917e-a835a0b2cbb0): created successfully Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2220c56-ab42-41e7-8cab-835ec12a121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (0ee70bac-3938-4496-b2d9-375a23398614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-46b3d7a8-6f50-4114-93e5-632271b3e13f tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:34 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc 1073741824" returned: 0 in 0.434s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:34 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc Aug 04 12:37:34 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:35 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.320s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110316812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03a3b9b-7652-47da-8a9d-5167fe84bf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff61a19cd344af8993044e5a431d1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:30Z,use_quota=True,user_id='ede480e2bfd748af9023f2a46832cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Creating volume a03a3b9b-7652-47da-8a9d-5167fe84bf90 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4835ba43-ce26-41d9-a8c1-00d28ccbaa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:35 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 1073741824 Aug 04 12:37:35 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d7b0-c282-4b53-94ed-1561c2a5ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc (ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc): created successfully Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d7b0-c282-4b53-94ed-1561c2a5ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (749dcceb-a4d3-481d-a9f9-e64f554a4690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0b8b570e-7da6-41dc-8e75-8a4ccca1b30c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:35 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 1073741824" returned: 0 in 0.434s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:35 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 Aug 04 12:37:35 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:35 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.840s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-522798464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695855b7-dc3a-4c65-ac31-97e14e0f65a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:31Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume 695855b7-dc3a-4c65-ac31-97e14e0f65a0 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58705a1e-1050-4845-bc52-37e4ceeac54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:35 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 1073741824 Aug 04 12:37:35 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e1c85-c416-4451-bcf9-4853f6544a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Volume volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 (a03a3b9b-7652-47da-8a9d-5167fe84bf90): created successfully Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2e1c85-c416-4451-bcf9-4853f6544a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:35 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Flow 'volume_create_manager' (73f99585-4737-4917-a48b-309b9001835a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-19476a6e-7073-45ac-9b67-6163adae2e1c tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created volume successfully. Aug 04 12:37:36 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-a03a3b9b-7652-47da-8a9d-5167fe84bf90-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 1073741824" returned: 0 in 0.442s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-a03a3b9b-7652-47da-8a9d-5167fe84bf90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:36 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-a03a3b9b-7652-47da-8a9d-5167fe84bf90" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:36 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-a03a3b9b-7652-47da-8a9d-5167fe84bf90" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ee522-2c3f-47bb-b947-20a2a7b5c9b1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:36 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 Aug 04 12:37:36 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:36 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.457s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a62896-ab4b-4671-8d4b-38f5109410e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f7969e928b4ff0bacf3e69738a2a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:29Z,use_quota=True,user_id='0f6aa8ee20cb4b98b4e3ecd4717c8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea718408-ab35-4112-8996-7e0083ccc4ae),volume_type_id=ea718408-ab35-4112-8996-7e0083ccc4ae)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Creating volume d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:36 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:36 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1073741824 Aug 04 12:37:36 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc45f15b-e501-4a5a-8809-6fac75bb387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3505af-4d07-4d01-8aa3-4fdaab9a75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:36 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 (695855b7-dc3a-4c65-ac31-97e14e0f65a0): created successfully Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3505af-4d07-4d01-8aa3-4fdaab9a75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (91bfb579-1915-48d5-9e25-93167e727424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b77ce6a0-4773-4bdb-82bb-6310f1a89521 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:36 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90" returned: 0 in 0.389s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:36 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90 Aug 04 12:37:36 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:36 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1073741824" returned: 0 in 0.425s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:36 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a03a3b9b-7652-47da-8a9d-5167fe84bf90" returned: 0 in 0.283s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 Aug 04 12:37:37 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-a03a3b9b-7652-47da-8a9d-5167fe84bf90" released by "delete_volume" :: held 0.716s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['63ba89fc-6c57-48ec-abc6-59ffc1f25d66', 'ce5780e2-bd47-457d-913e-1a860f5a538e', '70380add-6787-4fff-ace0-3ef70dd5eed0', 'ad364396-0897-4309-8a61-3d999ab69006'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:37 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.871s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315651109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a456615-736e-4058-bafb-89c44b804af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:31Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume 1a456615-736e-4058-bafb-89c44b804af7 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:37 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 1073741824 Aug 04 12:37:37 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Attempting download of 2107867e-0527-4837-8961-92a25eaaa0e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}])) to volume d0a62896-ab4b-4671-8d4b-38f5109410e1. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:37 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11fef0-5cb2-453a-952d-8d9aa659eeeb]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:37 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f8f49d92-1954-4a78-9afe-c045aded2730 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-a03a3b9b-7652-47da-8a9d-5167fe84bf90-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:37 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445 Aug 04 12:37:37 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679b7c0-c114-49ba-9f40-58acebcdcc9a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc Aug 04 12:37:37 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 1073741824" returned: 0 in 0.573s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445 Aug 04 12:37:37 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 Aug 04 12:37:37 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:37 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" returned: 0 in 0.415s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:37 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc Aug 04 12:37:37 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7" returned: 0 in 0.251s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:38 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.396s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682804366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffff359e-2abe-4d25-8802-d5e9899b88b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume ffff359e-2abe-4d25-8802-d5e9899b88b4 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:38 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445" returned: 1 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2107867e-0527-4837-8961-92a25eaaa0e3_s21e_445' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a082345-efbb-447d-804d-0437db0e1a98]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 1073741824 Aug 04 12:37:38 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26adec04-c93e-4da2-8bc2-abf804865a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a456615-736e-4058-bafb-89c44b804af7', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62215577-1895-4b68-81c1-db0f7426a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-1a456615-736e-4058-bafb-89c44b804af7 (1a456615-736e-4058-bafb-89c44b804af7): created successfully Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62215577-1895-4b68-81c1-db0f7426a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (c9dd1438-d542-4807-93b9-f1d3e9565dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:38 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9acd627d-eca0-4a3f-8c74-1d170a7330ce tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc" released by "delete_volume" :: held 0.739s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:38 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:38 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['90ab7fc6-3195-4095-af03-18105e1cb3cf', '96915724-e3c6-4f20-98dc-fc1b24fa4b96', 'a8d2c833-6160-4551-93fe-8d4de8d0cb80', 'ecc8f556-65b9-4ed0-a80c-e74afa7b5146'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:38 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-829b1024-89cd-4810-917e-a835a0b2cbb0-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-829b1024-89cd-4810-917e-a835a0b2cbb0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-829b1024-89cd-4810-917e-a835a0b2cbb0" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-829b1024-89cd-4810-917e-a835a0b2cbb0" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:38 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD Aug 04 12:37:38 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.358s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 1073741824" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f12f34-b762-4a35-8271-869bd273ec25]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a7ee70e9-211a-4464-ae5d-c8d46797e8d6 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-ea9b4222-7ac5-42c1-8bcd-5f959c84a9bc-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:38 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 Aug 04 12:37:38 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:38 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 Aug 04 12:37:38 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD" returned: 1 in 0.496s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] 2107867e-0527-4837-8961-92a25eaaa0e3 was raw, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 Aug 04 12:37:39 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4" returned: 0 in 0.354s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.075s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585135269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c78c7c-c9d6-4221-a4e2-2913bc6f6566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume 84c78c7c-c9d6-4221-a4e2-2913bc6f6566 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:39 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0" returned: 0 in 0.442s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 1073741824 Aug 04 12:37:39 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd101865-2dcf-4e20-b525-49401f5ef3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffff359e-2abe-4d25-8802-d5e9899b88b4', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91832361-997b-4f0d-8b6e-35c6e4e40f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:39 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0 Aug 04 12:37:39 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 (ffff359e-2abe-4d25-8802-d5e9899b88b4): created successfully Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91832361-997b-4f0d-8b6e-35c6e4e40f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (548dab08-098b-44a8-a43b-4476eb5b20f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-495d00b4-5bbe-4881-94c0-acf5ba55deff tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:39 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-829b1024-89cd-4810-917e-a835a0b2cbb0" returned: 0 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1" returned: 0 in 0.505s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2107867e-0527-4837-8961-92a25eaaa0e3_21sbc5fvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:37:39 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Converted 0.00 MB image at 0.00 MB/s Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-829b1024-89cd-4810-917e-a835a0b2cbb0" released by "delete_volume" :: held 0.861s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:39 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1G Aug 04 12:37:39 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['9d6f8aa8-ef5d-47a4-8d3c-c0a5d487ba72', 'bc003cf3-9aab-41ba-83ef-59a246bc6573', 'd8f5d1ba-f321-48b0-9ef9-2150711d1a91', 'b3ec59f1-8bb6-4574-b126-e2427def0e23'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 1073741824" returned: 0 in 0.517s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:39 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:39 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:39 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 Aug 04 12:37:39 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b05303-90d8-463a-9b09-5202000d6c5e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:40 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 1G" returned: 0 in 0.482s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Downloaded image 2107867e-0527-4837-8961-92a25eaaa0e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}])) to volume d0a62896-ab4b-4671-8d4b-38f5109410e1 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Temporary image 2107867e-0527-4837-8961-92a25eaaa0e3 for user 0f6aa8ee20cb4b98b4e3ecd4717c8b85 is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Marking volume d0a62896-ab4b-4671-8d4b-38f5109410e1 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Copying metadata from image 2107867e-0527-4837-8961-92a25eaaa0e3 to d0a62896-ab4b-4671-8d4b-38f5109410e1. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Creating volume glance metadata for volume d0a62896-ab4b-4671-8d4b-38f5109410e1 backed by image 2107867e-0527-4837-8961-92a25eaaa0e3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3a8c8c331307fae610f3aff3bffcb045', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:37:40 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.369s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:40 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d Aug 04 12:37:40 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:40 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-54451e14-61eb-42fd-bed6-1d8a32ca8aa3 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-829b1024-89cd-4810-917e-a835a0b2cbb0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.697s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414357070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606ae606-7422-4279-9ec6-dbd1279b5bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b143f13e3348de8c2d140a6d305cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:32Z,use_quota=True,user_id='b14f621cf9ef427da9bb1226957929d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Creating volume 606ae606-7422-4279-9ec6-dbd1279b5bdb {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5f055-3252-4644-85a6-825fa583458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:40 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb 1073741824 Aug 04 12:37:40 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7effcd68-5daf-4fe7-82e4-ca97256b03c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 (84c78c7c-c9d6-4221-a4e2-2913bc6f6566): created successfully Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7effcd68-5daf-4fe7-82e4-ca97256b03c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (34a57eb2-db38-456e-b80b-9e26f8439905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1891b9-e320-44c8-b987-a99f065d197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a62896-ab4b-4671-8d4b-38f5109410e1', 'volume_size': 1, 'image_id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2107867e-0527-4837-8961-92a25eaaa0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a8c8c331307fae610f3aff3bffcb045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f7969e928b4ff0bacf3e69738a2a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '09b65357c8faecbe88ffeecb8b78b6b734ba798f00226ce5ba18fd4e1587e3e3e37f1e2d7728f17636f984e9317481c3592404f1a9329f0421a2878a93679a96', 'id': '2107867e-0527-4837-8961-92a25eaaa0e3', 'created_at': datetime.datetime(2026, 8, 4, 10, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 37, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2107867e-0527-4837-8961-92a25eaaa0e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9a2fbc-a00e-410d-aedd-f9baf4d238ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-12f5209d-f2e8-41bc-b89e-02ef7b3850fe tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Volume volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 (d0a62896-ab4b-4671-8d4b-38f5109410e1): created successfully Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9a2fbc-a00e-410d-aedd-f9baf4d238ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Flow 'volume_create_manager' (befdd4fc-79e0-4d97-813a-52b35eadc4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5bcaf731-ca05-4859-a670-4adc4466b98f tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Created volume successfully. Aug 04 12:37:40 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" returned: 0 in 0.435s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:40 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d Aug 04 12:37:40 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:40 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb 1073741824" returned: 0 in 0.491s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" returned: 0 in 0.272s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d" released by "delete_volume" :: held 0.760s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:40 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb Aug 04 12:37:40 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['2f3adba1-4e0b-4b6d-ac08-63ad0c68ceb7', '4a7ab275-c4bc-4a5f-bc39-ee682cefb9f6', 'eea4b06f-2635-4c9b-a258-be3545edc5db', '5bfdaf44-555e-46e6-99cb-19b871350ab3'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:40 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:40 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:40 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb" returned: 0 in 0.253s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.615s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5-9662f897-2f55-45b3-b936-bf0cb70c8fdb" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ef26a5-459d-43c5-b433-b0c1c0644db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606ae606-7422-4279-9ec6-dbd1279b5bdb', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6879dbff-a5ac-4753-867d-fed9bd39e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5-9662f897-2f55-45b3-b936-bf0cb70c8fdb" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Creating volume 9662f897-2f55-45b3-b936-bf0cb70c8fdb from snapshot f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-2fd2d719-37e1-45ae-9278-c72346863523-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Volume volume-606ae606-7422-4279-9ec6-dbd1279b5bdb (606ae606-7422-4279-9ec6-dbd1279b5bdb): created successfully Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6879dbff-a5ac-4753-867d-fed9bd39e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Flow 'volume_create_manager' (21134e25-641c-49fe-9b0a-07f586282e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] snapshot: f22fe655-160c-4e50-86d6-eff2163d14d5, volume: 9662f897-2f55-45b3-b936-bf0cb70c8fdb, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:37:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-41203628-830d-475b-b8d5-2ae41da17772 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created volume successfully. Aug 04 12:37:41 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.293s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-2fd2d719-37e1-45ae-9278-c72346863523-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e828e95-7496-4a4b-8153-52cd542030bd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Acquiring lock "cinder-d0a62896-ab4b-4671-8d4b-38f5109410e1-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-750f0ae6-67d5-4daf-9c3f-efffbd4466ea tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-3ff74347-7a68-4bb2-af2f-7b4f4c2f7e0d-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "cinder-d0a62896-ab4b-4671-8d4b-38f5109410e1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-2fd2d719-37e1-45ae-9278-c72346863523" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-606ae606-7422-4279-9ec6-dbd1279b5bdb-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-2fd2d719-37e1-45ae-9278-c72346863523" acquired by "delete_volume" :: waited 0.039s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:41 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321918f-23b6-49ec-9d0e-e3f214548489]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-606ae606-7422-4279-9ec6-dbd1279b5bdb-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Acquiring lock "cinder-quobyte-d0a62896-ab4b-4671-8d4b-38f5109410e1" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "cinder-quobyte-d0a62896-ab4b-4671-8d4b-38f5109410e1" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca2907-4e50-444c-8814-12f13ff65c0a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-606ae606-7422-4279-9ec6-dbd1279b5bdb" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-606ae606-7422-4279-9ec6-dbd1279b5bdb" acquired by "delete_volume" :: waited 0.025s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:41 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 Aug 04 12:37:41 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30bd486-215e-4f74-833b-abde4f643b63]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 Aug 04 12:37:41 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb Aug 04 12:37:41 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bbeb990-4ca0-412c-9873-016e5e23f951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef928f-9a7e-47aa-8e85-1746352262ee]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523" returned: 0 in 0.415s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523 Aug 04 12:37:41 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:41 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1" returned: 0 in 0.457s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:41 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1 Aug 04 12:37:41 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb" returned: 0 in 0.424s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:41 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb Aug 04 12:37:41 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2fd2d719-37e1-45ae-9278-c72346863523" returned: 0 in 0.297s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-2fd2d719-37e1-45ae-9278-c72346863523" released by "delete_volume" :: held 0.774s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:42 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.437s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:42 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb Aug 04 12:37:42 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['54deac2b-eef5-44ba-aaab-de21f9e90d55', '5b40084c-5414-4099-ac6b-6bf765675174', '6958eb4d-f7e3-43b9-8863-cd12578bd8c0', 'f5ee068b-4ae7-4b7e-bdee-376d758f3feb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:42 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d0a62896-ab4b-4671-8d4b-38f5109410e1" returned: 0 in 0.292s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "cinder-quobyte-d0a62896-ab4b-4671-8d4b-38f5109410e1" released by "delete_volume" :: held 0.808s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:42 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-606ae606-7422-4279-9ec6-dbd1279b5bdb" returned: 0 in 0.304s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-606ae606-7422-4279-9ec6-dbd1279b5bdb" released by "delete_volume" :: held 0.783s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:42 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:42 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Created reservations ['8d716cc9-1855-4726-be0e-1a579f1926c5', 'a04452c7-90a4-4125-9427-edb4004bcddf', '3aa639a0-023b-438f-94da-5006c134d415', '5211bb84-9732-4bee-bb4a-b0cb026e336b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['a3e997ff-86fb-4dd1-af7d-789f6c0f3b03', 'c7d29f8b-7cf6-485c-9642-12e96331420a', 'f86056b6-3d62-4a70-af2f-c97c5f6bdca4', '5a3153e2-0175-49ab-8626-85a427e584ee'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:42 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:42 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-84c78c7c-c9d6-4221-a4e2-2913bc6f6566-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-84c78c7c-c9d6-4221-a4e2-2913bc6f6566-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:42 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:42 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ba1e0-a614-4713-8f22-01dc8f7f6201]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:42 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.384s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:42 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ac5af9b3-8c97-437b-a683-35f5a10c9ef4 tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-2fd2d719-37e1-45ae-9278-c72346863523-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:42 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 Aug 04 12:37:42 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:42 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.528s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:42 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:42 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Deleted volume successfully. Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-ec7b7058-8172-47a3-9f0a-c87a7bf6f525 tempest-VolumeAndVolumeTypeFromImageTest-2112781137 None] Lock "cinder-d0a62896-ab4b-4671-8d4b-38f5109410e1-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:43 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.683s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:43 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-af57e5ce-6b4e-4cb1-a0cb-3159ed3e70cd tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-606ae606-7422-4279-9ec6-dbd1279b5bdb-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" returned: 0 in 0.749s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:43 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566 Aug 04 12:37:43 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-c5fec92b-142a-4324-8571-b85aa8bb1b96-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-c5fec92b-142a-4324-8571-b85aa8bb1b96-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "cinder-quobyte-c5fec92b-142a-4324-8571-b85aa8bb1b96" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-c5fec92b-142a-4324-8571-b85aa8bb1b96" acquired by "delete_volume" :: waited 0.052s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5289525-31cc-455c-b923-90b36ff280a7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:44 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:44 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" returned: 0 in 0.645s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:44 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-84c78c7c-c9d6-4221-a4e2-2913bc6f6566" released by "delete_volume" :: held 1.464s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['81d2ee27-1441-4437-9040-4184f2f11e81', '1f28143f-667f-4907-98f6-9041123fe374', '6fd465c2-a8fd-4f31-9e55-37d5c1666f49', '7906e535-ae0b-49e7-b837-57a0a0bbd411'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:44 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:44 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:44 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96" returned: 0 in 0.684s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:44 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96 Aug 04 12:37:44 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-ffff359e-2abe-4d25-8802-d5e9899b88b4-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:45 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-c5fec92b-142a-4324-8571-b85aa8bb1b96" returned: 0 in 0.837s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-quobyte-c5fec92b-142a-4324-8571-b85aa8bb1b96" released by "delete_volume" :: held 1.675s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:45 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-ffff359e-2abe-4d25-8802-d5e9899b88b4-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 1.097s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-ffff359e-2abe-4d25-8802-d5e9899b88b4" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8ad494ab-6896-44ce-9782-4c7b96c9d45c tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-84c78c7c-c9d6-4221-a4e2-2913bc6f6566-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-ffff359e-2abe-4d25-8802-d5e9899b88b4" acquired by "delete_volume" :: waited 0.084s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Created reservations ['a8942048-6c2c-4ac4-9c86-b84039935049', '5a547c7e-985e-42d7-89ef-7d484afa6355', 'a4d6a388-52b2-479d-8355-257bca581714', 'a4a4ad50-810d-4615-a8ee-7bdd27dcf231'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d35c3b3-7d5c-4779-9179-112929604e36]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:46 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:46 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:46 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 Aug 04 12:37:46 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:46 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.606s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:46 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:46 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Deleted volume successfully. Aug 04 12:37:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9b2bdc4c-4b9a-486b-a845-df7e8701103d tempest-CreateVolumesFromSourceVolumeTest-1709446108 None] Lock "cinder-c5fec92b-142a-4324-8571-b85aa8bb1b96-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:47 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4" returned: 0 in 1.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:47 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4 Aug 04 12:37:47 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:47 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ffff359e-2abe-4d25-8802-d5e9899b88b4" returned: 0 in 0.566s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:47 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-ffff359e-2abe-4d25-8802-d5e9899b88b4" released by "delete_volume" :: held 2.067s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:47 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['c5601301-9c50-406c-9896-71aff6997b48', '3b3ac7b2-980f-4b09-bf1f-12968c272993', '86840624-2e8b-4d59-a949-e40944e37ed7', 'a7bd5978-bc8b-4eba-8d04-d753198a98db'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:48 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb" returned: 0 in 5.949s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:37:48 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Converted 1024.00 MB image at 172.12 MB/s Aug 04 12:37:48 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb is being set with open permissions: ugo+rw Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:48 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb Aug 04 12:37:48 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:48 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:48 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:48 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:48 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.303s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" released by "_copy_volume_from_snapshot" :: held 7.320s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2ca0ef04-5d65-4c1b-a09e-138444dc816b tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-ffff359e-2abe-4d25-8802-d5e9899b88b4-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5-9662f897-2f55-45b3-b936-bf0cb70c8fdb" released by "_create_volume_from_snapshot" :: held 7.459s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.509s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df0e0cf-617c-4ff3-aed3-e8fe2aa7d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb', 'volume_size': 1, 'snapshot_id': 'f22fe655-160c-4e50-86d6-eff2163d14d5'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d36910-2f9b-4ec1-8e63-5f8023c56a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:48 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Volume volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb (9662f897-2f55-45b3-b936-bf0cb70c8fdb): created successfully Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d36910-2f9b-4ec1-8e63-5f8023c56a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Flow 'volume_create_manager' (f30c8435-5713-44ef-8241-af030caa0d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-765b0821-bf20-4fc4-88df-2100a259f334 tempest-VolumeDependencyTests-932339492 None] Created volume successfully. Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-f22fe655-160c-4e50-86d6-eff2163d14d5-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-f22fe655-160c-4e50-86d6-eff2163d14d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Deleting offline snapshot f22fe655-160c-4e50-86d6-eff2163d14d5 of volume 2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] snapshot_file for this snap is: volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-1a456615-736e-4058-bafb-89c44b804af7-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb484d4-b2d8-46fd-9eb8-4fdad579655a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-1a456615-736e-4058-bafb-89c44b804af7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-1a456615-736e-4058-bafb-89c44b804af7" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-1a456615-736e-4058-bafb-89c44b804af7" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f21e8f1-7c0f-4a2f-b7e0-b94463eaeb92]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:49 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:49 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:49 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 Aug 04 12:37:49 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:49 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.484s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bbeb990-4ca0-412c-9873-016e5e23f951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b8122-b409-4b9b-9f1a-28281e77a6af]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:49 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:49 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7 Aug 04 12:37:49 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:49 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:49 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:49 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a456615-736e-4058-bafb-89c44b804af7" returned: 0 in 0.324s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-1a456615-736e-4058-bafb-89c44b804af7" released by "delete_volume" :: held 0.844s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['b4a2f204-2e89-443a-b02c-ba253a1a5b1b', 'a17cbc0e-88c4-479c-938e-5261f3618826', 'bd796dac-632d-41ed-a61c-c6a334cf91e0', '600280f7-6643-4ff5-ad49-7d823be9b919'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:50 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:50 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-695855b7-dc3a-4c65-ac31-97e14e0f65a0-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:50 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.704s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-695855b7-dc3a-4c65-ac31-97e14e0f65a0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:50 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:50 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-695855b7-dc3a-4c65-ac31-97e14e0f65a0" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-695855b7-dc3a-4c65-ac31-97e14e0f65a0" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e1dad-8f12-4b3c-aa17-c9b116e3bd44]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:50 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.419s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c0a6dcf4-f081-4bfc-a381-71977a98a0c8 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-1a456615-736e-4058-bafb-89c44b804af7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:50 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 Aug 04 12:37:50 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:50 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.483s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:50 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5 Aug 04 12:37:50 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:50 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0" returned: 0 in 0.490s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:50 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0 Aug 04 12:37:50 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:50 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951.f22fe655-160c-4e50-86d6-eff2163d14d5" returned: 0 in 0.303s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-f22fe655-160c-4e50-86d6-eff2163d14d5" released by "_delete_snapshot" :: held 2.128s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" released by "delete_snapshot" :: held 2.185s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Created reservations ['b6342209-0634-4d7d-bbc4-bb48eb03dbc8', '70c0719e-028e-4c11-803d-5bf54e25c965', '60bbf9af-9e31-48b5-af49-a458f318c80d', '9c212c6c-9d85-4981-95e0-66782217eab5'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:51 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-695855b7-dc3a-4c65-ac31-97e14e0f65a0" returned: 0 in 0.327s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-695855b7-dc3a-4c65-ac31-97e14e0f65a0" released by "delete_volume" :: held 0.880s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Delete snapshot completed successfully. Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3aaaf5ac-a732-478e-902d-b6c73ea0098e tempest-VolumeDependencyTests-932339492 None] Lock "cinder-f22fe655-160c-4e50-86d6-eff2163d14d5-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['17ec4116-c392-416c-abeb-f9ba2dd2ad11', 'f8ef4aba-4b7b-4d45-8a41-698629b7b63a', 'e7ff2e9c-242a-4c8c-8803-401cc591c86c', 'f15065b6-3fc5-4fd4-a252-5b30a99fdef4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Flow 'volume_create_manager' (0ffc345b-9988-41a4-8c0d-6afeb78b7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a198373-95b0-4410-b7f2-cfed1c0aa5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a198373-95b0-4410-b7f2-cfed1c0aa5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347370d7-a958-43ba-bd23-9cbfd351daf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908a7118c33641839ce5131a91800d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:51Z,use_quota=True,user_id='0de4c6355e74442aa73ae5817da1417a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536b905a-175d-469a-9279-8fd0387f872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536b905a-175d-469a-9279-8fd0387f872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb62154-4b16-4b6a-8a84-45dff0696330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb62154-4b16-4b6a-8a84-45dff0696330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347370d7-a958-43ba-bd23-9cbfd351daf2', 'volume_name': 'volume-347370d7-a958-43ba-bd23-9cbfd351daf2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02fa0b2-ecbe-4bb6-bf89-68005c2d6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02fa0b2-ecbe-4bb6-bf89-68005c2d6781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8562c5-6aff-442a-820d-89da4cfdd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Volume 347370d7-a958-43ba-bd23-9cbfd351daf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347370d7-a958-43ba-bd23-9cbfd351daf2', 'volume_size': 1} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347370d7-a958-43ba-bd23-9cbfd351daf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908a7118c33641839ce5131a91800d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:51Z,use_quota=True,user_id='0de4c6355e74442aa73ae5817da1417a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Creating volume 347370d7-a958-43ba-bd23-9cbfd351daf2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:51 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:51 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 1073741824 Aug 04 12:37:51 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:51 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:51 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:51 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.262s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9bf6ee1c-e36d-4a0b-94b2-5d9fc4affee6 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-695855b7-dc3a-4c65-ac31-97e14e0f65a0-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:51 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 1073741824" returned: 0 in 0.449s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:51 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 Aug 04 12:37:51 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:51 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-2bbeb990-4ca0-412c-9873-016e5e23f951-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-2bbeb990-4ca0-412c-9873-016e5e23f951-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:52 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" acquired by "delete_volume" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8562c5-6aff-442a-820d-89da4cfdd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347370d7-a958-43ba-bd23-9cbfd351daf2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a49afd-e674-4192-b244-6864c7cdc67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2040bae3-a95b-4f59-888e-24dcf3c5d86e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Volume volume-347370d7-a958-43ba-bd23-9cbfd351daf2 (347370d7-a958-43ba-bd23-9cbfd351daf2): created successfully Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a49afd-e674-4192-b244-6864c7cdc67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Flow 'volume_create_manager' (0ffc345b-9988-41a4-8c0d-6afeb78b7438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (016004a2-86f6-48cc-bd84-b4350d23889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a82c9a0-e57b-4cdb-b181-0f6bb59d66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-95d7fdb4-dd55-451e-a267-370c9fb37e13 tempest-CinderUnicodeTest-517812358 None] Created volume successfully. Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a82c9a0-e57b-4cdb-b181-0f6bb59d66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718288648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f47afd-997f-4feb-b1c6-82dbb45e0a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:52Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:52 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1cda7-5649-4076-aafc-c00955dd5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1cda7-5649-4076-aafc-c00955dd5822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8371c997-c322-4551-8091-3e450a032de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8371c997-c322-4551-8091-3e450a032de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f47afd-997f-4feb-b1c6-82dbb45e0a44', 'volume_name': 'volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6db3085-c6ef-4007-b45a-c62de71d4447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6db3085-c6ef-4007-b45a-c62de71d4447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ecab5-1022-401b-99a2-e30b26c690b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Volume 47f47afd-997f-4feb-b1c6-82dbb45e0a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44', 'volume_size': 1} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718288648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f47afd-997f-4feb-b1c6-82dbb45e0a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:52Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Creating volume 47f47afd-997f-4feb-b1c6-82dbb45e0a44 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:52 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-bd237b26-d15f-4c27-bfea-d985ca262dd8-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:52 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 1073741824 Aug 04 12:37:52 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-bd237b26-d15f-4c27-bfea-d985ca262dd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-bd237b26-d15f-4c27-bfea-d985ca262dd8" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-bd237b26-d15f-4c27-bfea-d985ca262dd8" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleting offline snapshot bd237b26-d15f-4c27-bfea-d985ca262dd8 of volume 9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] snapshot_file for this snap is: volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3c15c-519f-462c-aad7-c10056cf9358]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:52 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 Aug 04 12:37:52 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (baa0e955-3b2e-4d34-bbcf-1faa0906c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f721ed-e090-4a99-9cc1-d7c13d1ebf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.563s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f721ed-e090-4a99-9cc1-d7c13d1ebf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-620973437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d34b060-17d6-4891-b863-c763b563d3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:53Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f855a-8657-490b-b95f-e24aae9535a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f855a-8657-490b-b95f-e24aae9535a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951 Aug 04 12:37:52 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ae8abe-df4e-4a86-8923-536b852df172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ae8abe-df4e-4a86-8923-536b852df172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d34b060-17d6-4891-b863-c763b563d3df', 'volume_name': 'volume-2d34b060-17d6-4891-b863-c763b563d3df', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad2e319-8942-47aa-8b86-12bd7b0af910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad2e319-8942-47aa-8b86-12bd7b0af910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3adba-da07-489e-b147-6b65cb7e76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:52 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Volume 2d34b060-17d6-4891-b863-c763b563d3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d34b060-17d6-4891-b863-c763b563d3df', 'volume_size': 1} Aug 04 12:37:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:53 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8" returned: 0 in 0.437s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:37:53 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 1073741824" returned: 0 in 0.673s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9dc91f-464f-4bc0-87e8-d8dad375c666]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:53 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2bbeb990-4ca0-412c-9873-016e5e23f951" returned: 0 in 0.430s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:53 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 Aug 04 12:37:53 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-2bbeb990-4ca0-412c-9873-016e5e23f951" released by "delete_volume" :: held 1.125s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:53 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 Aug 04 12:37:53 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (c7180963-0903-44ee-9dfe-aa9f51f3be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5666f1-5360-4888-8bc5-b732c0ec419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5666f1-5360-4888-8bc5-b732c0ec419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733036204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1456a5-45aa-4034-a381-081166e1514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:53Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f7b35-8c38-4e14-ad13-a3894bddcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f7b35-8c38-4e14-ad13-a3894bddcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1185e92d-8dcb-4334-971f-e0ae82aac60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1185e92d-8dcb-4334-971f-e0ae82aac60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1456a5-45aa-4034-a381-081166e1514c', 'volume_name': 'volume-5f1456a5-45aa-4034-a381-081166e1514c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51314dc0-ef03-44e9-84a7-d69c0fb61e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51314dc0-ef03-44e9-84a7-d69c0fb61e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c601ef-6c18-4ab3-a34f-68dd5fe6058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Volume 5f1456a5-45aa-4034-a381-081166e1514c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1456a5-45aa-4034-a381-081166e1514c', 'volume_size': 1} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Created reservations ['8eccae3e-9890-4a12-b910-0616f9d4a917', '31797aa4-9b03-4cb5-91ea-3fb27384a49c', '6bf99573-0566-47e4-b97d-e97508f0d6c4', '0f77fcfd-2d36-4550-a4f8-b82180d0730c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:53 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44" returned: 0 in 0.515s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:53 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:53 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-620973437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d34b060-17d6-4891-b863-c763b563d3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:53Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Creating volume 2d34b060-17d6-4891-b863-c763b563d3df {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:53 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ecab5-1022-401b-99a2-e30b26c690b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df 1073741824 Aug 04 12:37:53 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12342af-9749-4492-aa05-784449e197ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" returned: 0 in 0.728s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:53 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Volume volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 (47f47afd-997f-4feb-b1c6-82dbb45e0a44): created successfully Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12342af-9749-4492-aa05-784449e197ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:53 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 Aug 04 12:37:53 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (016004a2-86f6-48cc-bd84-b4350d23889b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (a67a8acf-4ef7-4cb4-90a9-a04bab1d74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136c34fd-21d6-474f-89c0-f5caf10b9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bbd2a30e-cc86-4f7d-910e-612df7d667e8 tempest-CreateVolumesFromImageTest-1176847316 None] Created volume successfully. Aug 04 12:37:53 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136c34fd-21d6-474f-89c0-f5caf10b9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125935357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8f6eab-9022-4bb8-82d0-2543b7620559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:54Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da7cf2-2a57-4b73-be04-8b6f754fdff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da7cf2-2a57-4b73-be04-8b6f754fdff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047fff0f-7187-480e-9940-04b64c97d382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047fff0f-7187-480e-9940-04b64c97d382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8f6eab-9022-4bb8-82d0-2543b7620559', 'volume_name': 'volume-1a8f6eab-9022-4bb8-82d0-2543b7620559', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8549d87c-4b56-4b79-b96d-66c72cc7b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8549d87c-4b56-4b79-b96d-66c72cc7b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6cc10-2b6e-455b-bd0f-0d713b5899e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Volume 1a8f6eab-9022-4bb8-82d0-2543b7620559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8f6eab-9022-4bb8-82d0-2543b7620559', 'volume_size': 1} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:54 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.487s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Deleted volume successfully. Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-7d37060e-0085-4ab5-be3e-959a2a572d10 tempest-VolumeDependencyTests-932339492 None] Lock "cinder-2bbeb990-4ca0-412c-9873-016e5e23f951-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-9662f897-2f55-45b3-b936-bf0cb70c8fdb-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:54 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df 1073741824" returned: 0 in 0.653s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "cinder-9662f897-2f55-45b3-b936-bf0cb70c8fdb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:54 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8" returned: 0 in 0.658s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:54 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df Aug 04 12:37:54 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Acquiring lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:54 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8 Aug 04 12:37:54 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[07531cdd-f831-4199-aae9-1d9628c830cf]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (91e1f557-19f3-4541-8916-d133310005f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62caa496-968e-461c-8ce2-9a41440d7fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb Aug 04 12:37:54 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:54 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df" returned: 0 in 0.261s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Flow 'volume_create_manager' (11489917-27f5-48f7-805a-f414d7185bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4abd6b-d08d-4899-8fe4-9dc5ae1a658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733036204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1456a5-45aa-4034-a381-081166e1514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:53Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Creating volume 5f1456a5-45aa-4034-a381-081166e1514c {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62caa496-968e-461c-8ce2-9a41440d7fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546835490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63debbe7-c261-438e-9f85-a3486f04192b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:55Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda320d0-967b-4ba4-8a90-05ecd2cbb730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c 1073741824 Aug 04 12:37:54 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda320d0-967b-4ba4-8a90-05ecd2cbb730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c9bd4f-47c4-4921-b7b0-5be53ec68600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c9bd4f-47c4-4921-b7b0-5be53ec68600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63debbe7-c261-438e-9f85-a3486f04192b', 'volume_name': 'volume-63debbe7-c261-438e-9f85-a3486f04192b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306e0455-250c-4033-907d-0a8a0ceff3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306e0455-250c-4033-907d-0a8a0ceff3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2ddd83-efdf-4442-9f88-dfb054b4e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Volume 63debbe7-c261-438e-9f85-a3486f04192b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63debbe7-c261-438e-9f85-a3486f04192b', 'volume_size': 1} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:54 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3adba-da07-489e-b147-6b65cb7e76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d34b060-17d6-4891-b863-c763b563d3df', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5818c2f1-3f50-4eb4-b4e5-9ea268592375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4abd6b-d08d-4899-8fe4-9dc5ae1a658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1871635465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0de324-a200-4ee6-8449-659b4e9f54a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908a7118c33641839ce5131a91800d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:55Z,use_quota=True,user_id='0de4c6355e74442aa73ae5817da1417a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593051c6-eee2-49e1-9217-f8e960f60991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593051c6-eee2-49e1-9217-f8e960f60991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db18143a-4efe-40f0-961b-0a86eea5ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db18143a-4efe-40f0-961b-0a86eea5ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0de324-a200-4ee6-8449-659b4e9f54a2', 'volume_name': 'volume-ac0de324-a200-4ee6-8449-659b4e9f54a2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddec5009-8718-493a-a5a5-a3f7937019c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddec5009-8718-493a-a5a5-a3f7937019c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae02f7c-400a-4178-8b92-0071cd1f3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Volume ac0de324-a200-4ee6-8449-659b4e9f54a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0de324-a200-4ee6-8449-659b4e9f54a2', 'volume_size': 1} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22.bd237b26-d15f-4c27-bfea-d985ca262dd8" returned: 0 in 0.421s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Volume volume-2d34b060-17d6-4891-b863-c763b563d3df (2d34b060-17d6-4891-b863-c763b563d3df): created successfully Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5818c2f1-3f50-4eb4-b4e5-9ea268592375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (baa0e955-3b2e-4d34-bbcf-1faa0906c89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-bd237b26-d15f-4c27-bfea-d985ca262dd8" released by "_delete_snapshot" :: held 2.397s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:54 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d692923d-0968-4c06-aa18-70e242bdccb1 tempest-CreateVolumesFromImageTest-1176847316 None] Created volume successfully. Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" released by "delete_snapshot" :: held 2.456s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:54 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb" returned: 0 in 0.444s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:55 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb Aug 04 12:37:55 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['8151b405-9fc4-40c1-b633-b8db7ee5c449', '0da62fbe-df8c-4a78-8543-ac059a937658', '16f6c728-9d80-498e-8599-fb86d7a853b0', 'be2d2ed4-4fe0-47de-8629-9a7d84ec2d96'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Delete snapshot completed successfully. Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c13331c3-e4dc-45c6-a20d-e77b0b1ce393 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-bd237b26-d15f-4c27-bfea-d985ca262dd8-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:55 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c 1073741824" returned: 0 in 0.505s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:55 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9662f897-2f55-45b3-b936-bf0cb70c8fdb" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "cinder-quobyte-9662f897-2f55-45b3-b936-bf0cb70c8fdb" released by "delete_volume" :: held 0.776s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:55 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c Aug 04 12:37:55 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Created reservations ['a229468c-32dc-4c3d-9288-9875391ef6ed', 'd6a34693-2e86-401f-a294-40ad6e5365dd', '823c1656-d40d-4a4a-aa6e-b78e867be278', '51f1fff7-ee0d-458c-b53e-3638a9d931eb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:55 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:55 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:55 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c" returned: 0 in 0.292s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125935357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8f6eab-9022-4bb8-82d0-2543b7620559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:54Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Creating volume 1a8f6eab-9022-4bb8-82d0-2543b7620559 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:55 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c601ef-6c18-4ab3-a34f-68dd5fe6058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1456a5-45aa-4034-a381-081166e1514c', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:55 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 1073741824 Aug 04 12:37:55 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e33b7b9-28ab-4cb5-ad0f-e4f2e039a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Volume volume-5f1456a5-45aa-4034-a381-081166e1514c (5f1456a5-45aa-4034-a381-081166e1514c): created successfully Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e33b7b9-28ab-4cb5-ad0f-e4f2e039a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (c7180963-0903-44ee-9dfe-aa9f51f3be12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-42c40026-75ca-4d48-b051-dc4926782412 tempest-CreateVolumesFromImageTest-1176847316 None] Created volume successfully. Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:55 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.396s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Deleted volume successfully. Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ebb05e-fbf6-447c-bb7b-43f5918494c5]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-b9335d71-faff-4a6e-bebb-2612e6af60bf tempest-VolumeDependencyTests-932339492 None] Lock "cinder-9662f897-2f55-45b3-b936-bf0cb70c8fdb-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:55 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 Aug 04 12:37:55 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:56 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 1073741824" returned: 0 in 0.544s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:56 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" returned: 0 in 0.391s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:56 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:56 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:56 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22 Aug 04 12:37:56 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:56 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:56 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546835490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63debbe7-c261-438e-9f85-a3486f04192b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415b7e6a252b4878ae0c2e32b8baae61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:55Z,use_quota=True,user_id='0ed6d1c0495c4f0a84c7ba5d5631bbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Creating volume 63debbe7-c261-438e-9f85-a3486f04192b {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:56 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:56 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b 1073741824 Aug 04 12:37:56 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6cc10-2b6e-455b-bd0f-0d713b5899e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8f6eab-9022-4bb8-82d0-2543b7620559', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4870a15e-1f34-4950-b118-20b80c1ace50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-quobyte-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22" released by "delete_volume" :: held 0.839s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Volume volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 (1a8f6eab-9022-4bb8-82d0-2543b7620559): created successfully Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4870a15e-1f34-4950-b118-20b80c1ace50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (a67a8acf-4ef7-4cb4-90a9-a04bab1d74d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:56 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7b8a0f11-bee4-4007-84eb-568d9a05218f tempest-CreateVolumesFromImageTest-1176847316 None] Created volume successfully. Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Created reservations ['2c72af86-11c0-4fd2-8063-b1e2d686ce10', '7cd36260-af0d-451f-80e2-62e1295ca6b2', '20b93499-b4ad-433a-bc63-363630646e8a', '72a8b822-acfc-4e0c-94d0-fea95dad336b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:56 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:56 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:57 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:57 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.323s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b 1073741824" returned: 0 in 0.542s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Deleted volume successfully. Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-04ec9a46-7ec5-43e3-80fe-e6b3c411d259 tempest-CreateVolumesFromSnapshotTest-339292471 None] Lock "cinder-9eb4857f-a7cb-48bf-845d-5c2c2a38bc22-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:57 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b Aug 04 12:37:57 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:57 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:37:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1871635465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0de324-a200-4ee6-8449-659b4e9f54a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908a7118c33641839ce5131a91800d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:37:55Z,use_quota=True,user_id='0de4c6355e74442aa73ae5817da1417a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Creating volume ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:37:57 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:57 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 1073741824 Aug 04 12:37:57 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2ddd83-efdf-4442-9f88-dfb054b4e562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63debbe7-c261-438e-9f85-a3486f04192b', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4ba12-3377-498a-b4bc-279ca4ef0d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Volume volume-63debbe7-c261-438e-9f85-a3486f04192b (63debbe7-c261-438e-9f85-a3486f04192b): created successfully Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4ba12-3377-498a-b4bc-279ca4ef0d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Flow 'volume_create_manager' (91e1f557-19f3-4541-8916-d133310005f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-071ec322-0b0e-4def-af5b-c591756ea7ee tempest-CreateVolumesFromImageTest-1176847316 None] Created volume successfully. Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-63debbe7-c261-438e-9f85-a3486f04192b-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-63debbe7-c261-438e-9f85-a3486f04192b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-quobyte-63debbe7-c261-438e-9f85-a3486f04192b" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-63debbe7-c261-438e-9f85-a3486f04192b" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb60ab2-f490-4f54-aee2-f54494af59fe]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:58 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b Aug 04 12:37:58 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:58 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 1073741824" returned: 0 in 0.626s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:58 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 Aug 04 12:37:58 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:58 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b" returned: 0 in 0.460s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:58 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b Aug 04 12:37:58 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:58 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2" returned: 0 in 0.409s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae02f7c-400a-4178-8b92-0071cd1f3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0de324-a200-4ee6-8449-659b4e9f54a2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243ad28a-87ab-4437-9b65-6aea1f602301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:37:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Volume volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 (ac0de324-a200-4ee6-8449-659b4e9f54a2): created successfully Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243ad28a-87ab-4437-9b65-6aea1f602301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Flow 'volume_create_manager' (11489917-27f5-48f7-805a-f414d7185bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:37:58 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-69d3030a-c5eb-4340-8617-d9499e920bd4 tempest-CinderUnicodeTest-517812358 None] Created volume successfully. Aug 04 12:37:58 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-63debbe7-c261-438e-9f85-a3486f04192b" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-63debbe7-c261-438e-9f85-a3486f04192b" released by "delete_volume" :: held 0.858s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Created reservations ['8d494339-a08e-4469-8109-32a3f8213598', '0344906b-e9b6-43a8-81bb-8cc0732f40f6', '729087b2-d662-4611-96dd-8c6cd734ea51', '619446ee-c5a6-419a-a7f4-488029fc004d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:37:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:58 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:37:58 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-1a8f6eab-9022-4bb8-82d0-2543b7620559-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-1a8f6eab-9022-4bb8-82d0-2543b7620559-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-quobyte-1a8f6eab-9022-4bb8-82d0-2543b7620559" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-1a8f6eab-9022-4bb8-82d0-2543b7620559" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce783af2-736c-4151-911a-b91220bb2e3e]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:59 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.296s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:37:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Deleted volume successfully. Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-8c4b0cbc-032c-4166-bcf1-c77affdf3e88 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-63debbe7-c261-438e-9f85-a3486f04192b-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:59 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 Aug 04 12:37:59 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:59 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559" returned: 0 in 0.406s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:37:59 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559 Aug 04 12:37:59 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:37:59 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1a8f6eab-9022-4bb8-82d0-2543b7620559" returned: 0 in 0.322s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-1a8f6eab-9022-4bb8-82d0-2543b7620559" released by "delete_volume" :: held 0.793s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:37:59 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Creating offline snapshot c65d8b21-dfc3-4e23-a269-b6343c2a1868 of volume ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c453ebe-7114-421d-bcf1-5b7418a6ba83]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Created reservations ['8c1b7daa-e7aa-48d6-bd84-7d714cb34bb0', 'a01c9fb5-3040-4832-8707-ed6bb307955d', '3b7559ee-7920-4a1f-8bbd-1137f8bc3bdb', '3ab7a3f5-6ee2-4932-81b0-f6e49f07deb2'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:00 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 Aug 04 12:38:00 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:00 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:00 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-5f1456a5-45aa-4034-a381-081166e1514c-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-5f1456a5-45aa-4034-a381-081166e1514c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-quobyte-5f1456a5-45aa-4034-a381-081166e1514c" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-5f1456a5-45aa-4034-a381-081166e1514c" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dbef35-84ed-47fc-ac42-3371107c3692]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:00 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.339s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Deleted volume successfully. Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-75ccc68a-fc1d-41e3-95a4-cef7eee0a6b0 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-1a8f6eab-9022-4bb8-82d0-2543b7620559-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:00 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2" returned: 0 in 0.532s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:00 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 1G Aug 04 12:38:00 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:00 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c Aug 04 12:38:00 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a90c6737-f80f-432f-86b2-23e98d3443b3 tempest-ProjectAdminTests-2063799544 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88895) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 04 12:38:00 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c" returned: 0 in 0.491s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:00 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c Aug 04 12:38:00 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:01 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 1G" returned: 0 in 0.570s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:01 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 Aug 04 12:38:01 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:01 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-5f1456a5-45aa-4034-a381-081166e1514c" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-5f1456a5-45aa-4034-a381-081166e1514c" released by "delete_volume" :: held 0.893s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Created reservations ['58d32b98-cca8-412d-b245-8f9e4455b556', '8580b8ee-c6f4-4c7a-bff5-c77f8982cd53', '7f782869-918b-4323-9ea9-e9e470d5cdc5', '73e342cb-f54e-4c0d-b091-118842b586b0'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:01 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868" returned: 0 in 0.427s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:01 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 is being set with open permissions: ugo+rw Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:01 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 Aug 04 12:38:01 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:01 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:01 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:01 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868" returned: 0 in 0.315s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:01 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info Aug 04 12:38:01 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:01 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.312s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Deleted volume successfully. Aug 04 12:38:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d9a165a-5964-406a-b2d6-babc8534b962 tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-5f1456a5-45aa-4034-a381-081166e1514c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:02 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info" returned: 0 in 0.272s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:02 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info is being set with open permissions: ugo+rw Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:02 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info Aug 04 12:38:02 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:02 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.info" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-745403b9-60c7-4f9d-b40b-0fb4c93f2c05 tempest-CinderUnicodeTest-517812358 None] Create snapshot completed successfully Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-2d34b060-17d6-4891-b863-c763b563d3df-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-2d34b060-17d6-4891-b863-c763b563d3df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-quobyte-2d34b060-17d6-4891-b863-c763b563d3df" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-2d34b060-17d6-4891-b863-c763b563d3df" acquired by "delete_volume" :: waited 0.032s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb632e54-5c7d-4b69-a439-7643661e625c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:02 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df Aug 04 12:38:02 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:03 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-c65d8b21-dfc3-4e23-a269-b6343c2a1868-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-c65d8b21-dfc3-4e23-a269-b6343c2a1868-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:03 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df Aug 04 12:38:03 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-quobyte-c65d8b21-dfc3-4e23-a269-b6343c2a1868" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-c65d8b21-dfc3-4e23-a269-b6343c2a1868" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Deleting offline snapshot c65d8b21-dfc3-4e23-a269-b6343c2a1868 of volume ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] snapshot_file for this snap is: volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b247e59-a2db-4170-9303-919663dc709f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:03 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 Aug 04 12:38:03 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:03 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-2d34b060-17d6-4891-b863-c763b563d3df" returned: 0 in 0.309s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-2d34b060-17d6-4891-b863-c763b563d3df" released by "delete_volume" :: held 0.818s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Created reservations ['c857e3c6-0906-42de-ac37-294919e537da', 'd9ebf09b-81f2-4de9-a0f1-d69b66e1763c', '84743829-49f4-40de-9fd4-b862bef5186a', '452f2be4-d114-4795-9f9f-ac5270ad5e28'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:03 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:03 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:03 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-47f47afd-997f-4feb-b1c6-82dbb45e0a44-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868" returned: 0 in 0.537s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0de324-a200-4ee6-8449-659b4e9f54a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a2ea6-5ce6-40bc-902f-536bdd0ec667]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-47f47afd-997f-4feb-b1c6-82dbb45e0a44-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "cinder-quobyte-47f47afd-997f-4feb-b1c6-82dbb45e0a44" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-47f47afd-997f-4feb-b1c6-82dbb45e0a44" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b598697-0f1b-4769-b5f7-748e530d2576]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:03 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:03 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:03 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Deleted volume successfully. Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3592d53f-af31-4ecf-bc2a-629fb220180b tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-2d34b060-17d6-4891-b863-c763b563d3df-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:04 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 Aug 04 12:38:04 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:04 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 Aug 04 12:38:04 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:04 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2" returned: 0 in 0.431s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:04 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 Aug 04 12:38:04 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:04 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44" returned: 0 in 0.424s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:04 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44 Aug 04 12:38:04 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:04 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-47f47afd-997f-4feb-b1c6-82dbb45e0a44" returned: 0 in 0.274s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:04 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868" returned: 0 in 0.391s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-quobyte-47f47afd-997f-4feb-b1c6-82dbb45e0a44" released by "delete_volume" :: held 0.759s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:04 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868 Aug 04 12:38:04 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Created reservations ['4ae2ec96-1823-4b3e-a515-0db817408b5d', 'd178f292-b1cf-4865-b017-cd59b85b65d7', '5452f246-eb0b-44ec-8cfc-18cc902b9279', '243d8ae7-ff62-4228-bf45-009edc5a4998'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:04 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:04 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:05 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2.c65d8b21-dfc3-4e23-a269-b6343c2a1868" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-c65d8b21-dfc3-4e23-a269-b6343c2a1868" released by "_delete_snapshot" :: held 1.881s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" released by "delete_snapshot" :: held 1.909s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Created reservations ['ce8dcac3-9b7f-4e84-a7bd-4ed998daa3f0', 'b7f281ae-0917-4772-b04f-fe1c9f24daac', '7055e978-3001-4533-941e-7caffea4d1dc', '4e35dcf2-2794-48c6-a7e4-ad1b91ee622d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:05 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.376s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Deleted volume successfully. Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c7794295-2893-408d-9364-83a099767a5f tempest-CreateVolumesFromImageTest-1176847316 None] Lock "cinder-47f47afd-997f-4feb-b1c6-82dbb45e0a44-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Delete snapshot completed successfully. Aug 04 12:38:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-329886f9-caf4-4653-9312-b0be973f7d38 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-c65d8b21-dfc3-4e23-a269-b6343c2a1868-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:06 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:06 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-ac0de324-a200-4ee6-8449-659b4e9f54a2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-ac0de324-a200-4ee6-8449-659b4e9f54a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" acquired by "delete_volume" :: waited 0.023s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[992182b7-7774-41c4-822a-704e7ff6386c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:06 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.431s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:38:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:38:06 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 Aug 04 12:38:06 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:07 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2" returned: 0 in 0.532s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:07 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2 Aug 04 12:38:07 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:07 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac0de324-a200-4ee6-8449-659b4e9f54a2" returned: 0 in 0.433s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-ac0de324-a200-4ee6-8449-659b4e9f54a2" released by "delete_volume" :: held 1.076s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Created reservations ['0ac0c734-c95e-4353-b999-19dd17560e28', '534f44d9-b4f6-4e49-a109-45d4ae0d1703', 'fc1ef860-cb63-4e08-a16f-d136393f7dec', 'd5d6b20b-7390-4f82-b9c3-f08e8df96d4f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:07 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:07 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:08 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Deleted volume successfully. Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13a6d7f4-9d56-4f2f-b15b-04d9232309b3 tempest-CinderUnicodeTest-517812358 None] Lock "cinder-ac0de324-a200-4ee6-8449-659b4e9f54a2-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-347370d7-a958-43ba-bd23-9cbfd351daf2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "cinder-347370d7-a958-43ba-bd23-9cbfd351daf2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Acquiring lock "cinder-quobyte-347370d7-a958-43ba-bd23-9cbfd351daf2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-347370d7-a958-43ba-bd23-9cbfd351daf2" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[187bcdf4-14ac-4a43-9371-1d68f2db3607]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:09 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 Aug 04 12:38:09 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:09 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2" returned: 0 in 0.401s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:09 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2 Aug 04 12:38:09 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:09 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-347370d7-a958-43ba-bd23-9cbfd351daf2" returned: 0 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "cinder-quobyte-347370d7-a958-43ba-bd23-9cbfd351daf2" released by "delete_volume" :: held 0.787s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Created reservations ['6498dc16-a0b9-40cd-b028-9573fcfc3f6e', 'c4faa8e0-5d06-4566-b01b-39ef29f66ad2', '7e0a91d9-f81e-4f60-9f74-716bae3619d8', '13f6849d-343b-44c6-8114-7a76e8c4148b'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:09 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:09 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:10 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.295s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:10 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:10 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Deleted volume successfully. Aug 04 12:38:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d6c04db-b1a2-4996-9ec2-845bb8ff5e5d tempest-CinderUnicodeTest-517812358 None] Lock "cinder-347370d7-a958-43ba-bd23-9cbfd351daf2-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:12 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Flow 'volume_create_manager' (9664f02b-02c1-46c6-ab37-ad8183f1df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c0abb8-d777-40c3-9501-3b24649c0c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c0abb8-d777-40c3-9501-3b24649c0c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b7817f-a50a-48ce-9eef-bf5519605747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca8d1d32c2a144f0b5a5c3969890eb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:13Z,use_quota=True,user_id='21df583ca91245bcb6278187afc66b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dc08d0-ad54-46e4-b557-1af553fbf4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dc08d0-ad54-46e4-b557-1af553fbf4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5de86d-0d89-4aea-a2a4-b1412f35b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.image.glance [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Creating Keystone auth plugin from conf {{(pid=88895) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5de86d-0d89-4aea-a2a4-b1412f35b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4b7817f-a50a-48ce-9eef-bf5519605747', 'volume_name': 'volume-d4b7817f-a50a-48ce-9eef-bf5519605747', 'volume_size': 1, 'image_id': '5faf918d-98ca-4946-8652-836d019f6e18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18102c2b00246065aa7b28067b4829d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8d1d32c2a144f0b5a5c3969890eb22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '615a3fa303d7971230063c474c5b6aac371777e4bb9d423e831e195e582e9ff75f27abd3759000cdf74cef4ddd9110d0e714721d66c224689f6482ccb86f1c55', 'id': '5faf918d-98ca-4946-8652-836d019f6e18', 'created_at': datetime.datetime(2026, 8, 4, 10, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5faf918d-98ca-4946-8652-836d019f6e18/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e73566-bacc-487e-aaca-e86a29830a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e73566-bacc-487e-aaca-e86a29830a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a2de39-57aa-411c-8470-3d2ddb6693f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:13 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Volume d4b7817f-a50a-48ce-9eef-bf5519605747: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4b7817f-a50a-48ce-9eef-bf5519605747', 'volume_size': 1, 'image_id': '5faf918d-98ca-4946-8652-836d019f6e18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18102c2b00246065aa7b28067b4829d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8d1d32c2a144f0b5a5c3969890eb22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '615a3fa303d7971230063c474c5b6aac371777e4bb9d423e831e195e582e9ff75f27abd3759000cdf74cef4ddd9110d0e714721d66c224689f6482ccb86f1c55', 'id': '5faf918d-98ca-4946-8652-836d019f6e18', 'created_at': datetime.datetime(2026, 8, 4, 10, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5faf918d-98ca-4946-8652-836d019f6e18/file', 'properties': {}}, 'image_service': } Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Trying to clone d4b7817f-a50a-48ce-9eef-bf5519605747 from image 5faf918d-98ca-4946-8652-836d019f6e18 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}]). {{(pid=88895) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 04 12:38:13 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Image download 0.00 MB at 0.00 MB/s Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2e556-d868-4f18-bfb2-22f622e87e63]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:14 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:14 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:14 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:14 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:14 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:14 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 1 in 0.493s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Temporary image 5faf918d-98ca-4946-8652-836d019f6e18 is fetched for user 21df583ca91245bcb6278187afc66b4e. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7d7cdb-82da-4093-b522-edbfd5585857]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:15 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:15 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:15 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (cea2c548-eb47-4401-b876-89296211cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28db9ce9-dc76-451f-bf6c-f61b4b45b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28db9ce9-dc76-451f-bf6c-f61b4b45b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522240553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26c6add-4aee-4cb0-9c9d-d0c247899d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:15Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de430438-9d23-426b-842e-ffec19bfed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de430438-9d23-426b-842e-ffec19bfed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a1734d-04b8-4975-9c91-0b79fe5c2fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a1734d-04b8-4975-9c91-0b79fe5c2fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26c6add-4aee-4cb0-9c9d-d0c247899d0f', 'volume_name': 'volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389a5177-a386-404d-a420-a4b4650128b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389a5177-a386-404d-a420-a4b4650128b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d9660-4601-44b2-ba1f-4477408a1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Volume a26c6add-4aee-4cb0-9c9d-d0c247899d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f', 'volume_size': 1} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522240553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26c6add-4aee-4cb0-9c9d-d0c247899d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:15Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Creating volume a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:15 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f 1073741824 Aug 04 12:38:15 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:15 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:15 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:15 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:38:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:16 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f 1073741824" returned: 0 in 0.496s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=182,cinder:UPDATE=267,cinder:INSERT=64,cinder:DELETE=23 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=266,cinder:SELECT=203,cinder:INSERT=72,cinder:DELETE=24 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:16 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f Aug 04 12:38:16 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:16 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" returned: 0 in 0.326s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b7817f-a50a-48ce-9eef-bf5519605747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca8d1d32c2a144f0b5a5c3969890eb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:13Z,use_quota=True,user_id='21df583ca91245bcb6278187afc66b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Creating volume d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:16 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:16 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1073741824 Aug 04 12:38:16 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d9660-4601-44b2-ba1f-4477408a1500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95c0432-d47f-4fd6-8240-cc921e1bd5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Volume volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f (a26c6add-4aee-4cb0-9c9d-d0c247899d0f): created successfully Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95c0432-d47f-4fd6-8240-cc921e1bd5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (cea2c548-eb47-4401-b876-89296211cb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e67667da-3fac-43ef-90ef-ed7060cedf08 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:38:17 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1073741824" returned: 0 in 0.594s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:17 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 Aug 04 12:38:17 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:17 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747" returned: 0 in 0.267s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Attempting download of 5faf918d-98ca-4946-8652-836d019f6e18 ((None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}])) to volume d4b7817f-a50a-48ce-9eef-bf5519605747. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[df313e4a-ceca-4b57-a4f3-407ece416cd4]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:17 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9 Aug 04 12:38:17 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (e4a55318-4c46-4e35-b5f3-3a2ebe2ecde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b2edeb-5a01-4c99-b384-a817b3f0632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b2edeb-5a01-4c99-b384-a817b3f0632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332672787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05bed0c-a371-473c-9050-3e08a077aa15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:17Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07f32b-763d-40b4-a8c0-94decbdc8f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07f32b-763d-40b4-a8c0-94decbdc8f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb4effa-d245-49ce-88b3-5044892f352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb4effa-d245-49ce-88b3-5044892f352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05bed0c-a371-473c-9050-3e08a077aa15', 'volume_name': 'volume-f05bed0c-a371-473c-9050-3e08a077aa15', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b18d5-e52b-4dc8-bbff-ca8616f0acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48b18d5-e52b-4dc8-bbff-ca8616f0acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bf0155-3d00-412d-a845-23622efcf1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:17 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Volume f05bed0c-a371-473c-9050-3e08a077aa15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05bed0c-a371-473c-9050-3e08a077aa15', 'volume_size': 1} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-332672787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05bed0c-a371-473c-9050-3e08a077aa15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:17Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Creating volume f05bed0c-a371-473c-9050-3e08a077aa15 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:17 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:17 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 1073741824 Aug 04 12:38:17 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:17 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9" returned: 0 in 0.351s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:17 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9 Aug 04 12:38:17 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 1073741824" returned: 0 in 0.482s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9" returned: 1 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5faf918d-98ca-4946-8652-836d019f6e18__5vvgjf9' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[85226923-1eeb-4393-9332-4aa8944fd021]: (4, 'raw') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 Aug 04 12:38:18 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:18 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15" returned: 0 in 0.308s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.635s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bf0155-3d00-412d-a845-23622efcf1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05bed0c-a371-473c-9050-3e08a077aa15', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e8402-f27b-4ff5-bcb1-b93ca5fedf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot e268a1e1-2c4b-4da4-87c9-b1b96aa23583 of volume a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:18 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Volume volume-f05bed0c-a371-473c-9050-3e08a077aa15 (f05bed0c-a371-473c-9050-3e08a077aa15): created successfully Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e8402-f27b-4ff5-bcb1-b93ca5fedf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (e4a55318-4c46-4e35-b5f3-3a2ebe2ecde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d8c32-dd99-4b4d-bc87-551046bf0b83]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-ad708ffc-776d-4274-8bcc-b5cfa6273713 tempest-ProjectReaderTests-1931115641 None] Created volume successfully. Aug 04 12:38:18 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f Aug 04 12:38:18 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD Aug 04 12:38:18 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] 5faf918d-98ca-4946-8652-836d019f6e18 was raw, converting to qcow2 {{(pid=88895) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" returned: 0 in 0.412s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:18 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 Aug 04 12:38:18 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:18 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 1G Aug 04 12:38:18 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:19 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 1G" returned: 0 in 0.457s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:19 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 Aug 04 12:38:19 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:19 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747" returned: 0 in 0.543s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5faf918d-98ca-4946-8652-836d019f6e18_vwuivqtrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:38:19 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Converted 0.00 MB image at 0.00 MB/s Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:19 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1G Aug 04 12:38:19 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:19 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:19 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 is being set with open permissions: ugo+rw Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:19 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 Aug 04 12:38:19 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-f05bed0c-a371-473c-9050-3e08a077aa15-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:19 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 1G" returned: 0 in 0.429s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Downloaded image 5faf918d-98ca-4946-8652-836d019f6e18 ((None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}])) to volume d4b7817f-a50a-48ce-9eef-bf5519605747 successfully. {{(pid=88895) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Temporary image 5faf918d-98ca-4946-8652-836d019f6e18 for user 21df583ca91245bcb6278187afc66b4e is deleted. {{(pid=88895) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.volume.volume_utils [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Marking volume d4b7817f-a50a-48ce-9eef-bf5519605747 as bootable. {{(pid=88895) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-f05bed0c-a371-473c-9050-3e08a077aa15-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Copying metadata from image 5faf918d-98ca-4946-8652-836d019f6e18 to d4b7817f-a50a-48ce-9eef-bf5519605747. {{(pid=88895) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 04 12:38:19 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Creating volume glance metadata for volume d4b7817f-a50a-48ce-9eef-bf5519605747 backed by image 5faf918d-98ca-4946-8652-836d019f6e18 with: {'image_id': '5faf918d-98ca-4946-8652-836d019f6e18', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '18102c2b00246065aa7b28067b4829d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88895) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-quobyte-f05bed0c-a371-473c-9050-3e08a077aa15" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-f05bed0c-a371-473c-9050-3e08a077aa15" acquired by "delete_volume" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62748a8-ac77-41d3-8d56-c79343694cf7]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:20 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583" returned: 0 in 0.332s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a2de39-57aa-411c-8470-3d2ddb6693f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b7817f-a50a-48ce-9eef-bf5519605747', 'volume_size': 1, 'image_id': '5faf918d-98ca-4946-8652-836d019f6e18', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5faf918d-98ca-4946-8652-836d019f6e18', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18102c2b00246065aa7b28067b4829d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca8d1d32c2a144f0b5a5c3969890eb22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '615a3fa303d7971230063c474c5b6aac371777e4bb9d423e831e195e582e9ff75f27abd3759000cdf74cef4ddd9110d0e714721d66c224689f6482ccb86f1c55', 'id': '5faf918d-98ca-4946-8652-836d019f6e18', 'created_at': datetime.datetime(2026, 8, 4, 10, 38, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 10, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5faf918d-98ca-4946-8652-836d019f6e18/file', 'properties': {}}, 'image_service': }' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c891ba63-b9dc-4b33-8bba-f6f617b5b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:20 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Volume volume-d4b7817f-a50a-48ce-9eef-bf5519605747 (d4b7817f-a50a-48ce-9eef-bf5519605747): created successfully Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c891ba63-b9dc-4b33-8bba-f6f617b5b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Flow 'volume_create_manager' (9664f02b-02c1-46c6-ab37-ad8183f1df5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-bfde54ec-6e53-4afc-b31e-4a19faf4b6ab tempest-VolumeImageDependencyTests-1684359144 None] Created volume successfully. Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:20 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 Aug 04 12:38:20 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:20 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info Aug 04 12:38:20 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:20 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info" returned: 0 in 0.285s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:20 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info is being set with open permissions: ugo+rw Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:20 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info Aug 04 12:38:20 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Acquiring lock "cinder-d4b7817f-a50a-48ce-9eef-bf5519605747-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "cinder-d4b7817f-a50a-48ce-9eef-bf5519605747-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:20 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15" returned: 0 in 0.488s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:20 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15 Aug 04 12:38:20 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Acquiring lock "cinder-quobyte-d4b7817f-a50a-48ce-9eef-bf5519605747" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "cinder-quobyte-d4b7817f-a50a-48ce-9eef-bf5519605747" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d4fff-8639-4528-86d0-dd23681f6c9c]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:20 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.info" returned: 0 in 0.326s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:20 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 Aug 04 12:38:20 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6e2a4838-c727-484f-ad80-b6eab3d4fc2e tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:38:20 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-f05bed0c-a371-473c-9050-3e08a077aa15" returned: 0 in 0.305s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-f05bed0c-a371-473c-9050-3e08a077aa15" released by "delete_volume" :: held 0.848s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Created reservations ['44934616-3124-4fd3-a1f5-11455dec6bcc', '05e8c373-336a-4812-a471-69e202cab27e', '974ab05d-10d5-4661-91e5-e80f269c93e7', 'eecd0332-8c2b-4327-9a08-d48886f402df'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-e268a1e1-2c4b-4da4-87c9-b1b96aa23583-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-e268a1e1-2c4b-4da4-87c9-b1b96aa23583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-e268a1e1-2c4b-4da4-87c9-b1b96aa23583" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-e268a1e1-2c4b-4da4-87c9-b1b96aa23583" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot e268a1e1-2c4b-4da4-87c9-b1b96aa23583 of volume a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae7ce4-89d9-4ca4-9cf4-56c9a454d782]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:21 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747" returned: 0 in 0.503s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:21 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:21 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:21 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747 Aug 04 12:38:21 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:21 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 Aug 04 12:38:21 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:21 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:21 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-d4b7817f-a50a-48ce-9eef-bf5519605747" returned: 0 in 0.287s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "cinder-quobyte-d4b7817f-a50a-48ce-9eef-bf5519605747" released by "delete_volume" :: held 0.849s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:21 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Deleted volume successfully. Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-2dcd63ee-b632-4a02-a458-c9c12fb18da3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-f05bed0c-a371-473c-9050-3e08a077aa15-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:21 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583" returned: 0 in 0.450s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Created reservations ['b129d904-d96b-4299-bac5-d5c0980e3436', '37979cc1-6e59-42b0-8faa-2041f9afc18a', '1b2314b1-2708-4f78-bf28-d61580b6f18e', 'f8fa22da-16e2-4630-8e07-1d38c405d473'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7195880-b77e-43b3-9239-6b82474bcc7d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:21 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f Aug 04 12:38:21 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:21 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:21 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:22 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.306s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Deleted volume successfully. Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-13c03afd-3948-45f8-86f0-3994e2438208 tempest-VolumeImageDependencyTests-1684359144 None] Lock "cinder-d4b7817f-a50a-48ce-9eef-bf5519605747-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:22 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" returned: 0 in 0.508s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:22 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 Aug 04 12:38:22 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:22 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583" returned: 0 in 0.509s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:22 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583 Aug 04 12:38:22 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (f336f924-7f25-4338-8215-bfccc4d7f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa70d62a-bde6-4125-8dcb-abf461d79cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa70d62a-bde6-4125-8dcb-abf461d79cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151307913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6f2c88-c608-47f5-9109-13d14ae11273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:23Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f0b77-5bf7-4a8e-ac13-4d4d064a5313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f0b77-5bf7-4a8e-ac13-4d4d064a5313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7978244-f700-41a3-ae11-2a21b039c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7978244-f700-41a3-ae11-2a21b039c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6f2c88-c608-47f5-9109-13d14ae11273', 'volume_name': 'volume-ad6f2c88-c608-47f5-9109-13d14ae11273', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6651bd0f-6636-4dc3-915e-3b2694bed375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6651bd0f-6636-4dc3-915e-3b2694bed375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d360ccf-2879-4c39-90af-8b5a8a23376c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Volume ad6f2c88-c608-47f5-9109-13d14ae11273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6f2c88-c608-47f5-9109-13d14ae11273', 'volume_size': 1} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151307913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6f2c88-c608-47f5-9109-13d14ae11273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:23Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Creating volume ad6f2c88-c608-47f5-9109-13d14ae11273 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:22 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:22 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 1073741824 Aug 04 12:38:22 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:22 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f.e268a1e1-2c4b-4da4-87c9-b1b96aa23583" returned: 0 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-e268a1e1-2c4b-4da4-87c9-b1b96aa23583" released by "_delete_snapshot" :: held 1.932s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" released by "delete_snapshot" :: held 1.959s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Created reservations ['ef5d3b83-5863-4d78-9edb-bcd999c2c413', '975b7d48-013c-4d2e-a5da-ff5be319ea2c', '25e4ae49-370a-451b-9893-a6051ebbb6ac', 'e131b24f-7b4a-4a96-82c0-282c1df11ed6'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a12edeee-aef1-4bd1-b249-1e7290b385c9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-e268a1e1-2c4b-4da4-87c9-b1b96aa23583-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Flow 'volume_create_manager' (80518384-d344-4cb3-8054-319e8ffc63ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e772b1ef-9bd9-465c-8f31-52541d6de450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e772b1ef-9bd9-465c-8f31-52541d6de450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897165967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f503317-9fd8-4ee5-ab88-696ced0899b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925a6b6cc9e646be924d7b6eb2e49a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:23Z,use_quota=True,user_id='7f63febb8290480291864a09d13a63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d341b7fb-3909-4aeb-ae13-0ef460edcd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d341b7fb-3909-4aeb-ae13-0ef460edcd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebfa5ae-f0ea-4cb0-b3a6-781b4c0456e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebfa5ae-f0ea-4cb0-b3a6-781b4c0456e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f503317-9fd8-4ee5-ab88-696ced0899b3', 'volume_name': 'volume-1f503317-9fd8-4ee5-ab88-696ced0899b3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5107ecbd-4a65-4751-816d-31feb5940523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5107ecbd-4a65-4751-816d-31feb5940523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcfdec7-b87c-4d19-a282-919275daa692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Volume 1f503317-9fd8-4ee5-ab88-696ced0899b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f503317-9fd8-4ee5-ab88-696ced0899b3', 'volume_size': 1} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:23 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 1073741824" returned: 0 in 0.587s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:23 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 Aug 04 12:38:23 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:23 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273" returned: 0 in 0.272s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897165967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f503317-9fd8-4ee5-ab88-696ced0899b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925a6b6cc9e646be924d7b6eb2e49a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:23Z,use_quota=True,user_id='7f63febb8290480291864a09d13a63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Creating volume 1f503317-9fd8-4ee5-ab88-696ced0899b3 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:23 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d360ccf-2879-4c39-90af-8b5a8a23376c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6f2c88-c608-47f5-9109-13d14ae11273', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287fb9f4-057c-4b99-ba06-913b97a0e311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:23 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 1073741824 Aug 04 12:38:23 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Volume volume-ad6f2c88-c608-47f5-9109-13d14ae11273 (ad6f2c88-c608-47f5-9109-13d14ae11273): created successfully Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287fb9f4-057c-4b99-ba06-913b97a0e311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (f336f924-7f25-4338-8215-bfccc4d7f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c1d53788-c120-4ac1-8967-d9aa42d64f3f tempest-ProjectReaderTests-1931115641 None] Created volume successfully. Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-a26c6add-4aee-4cb0-9c9d-d0c247899d0f-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:24 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 1073741824" returned: 0 in 0.486s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a26c6add-4aee-4cb0-9c9d-d0c247899d0f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:24 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 Aug 04 12:38:24 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fb76f-edb9-4497-b040-bb3f6ffaa3ca]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:24 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f Aug 04 12:38:24 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:24 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3" returned: 0 in 0.252s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcfdec7-b87c-4d19-a282-919275daa692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f503317-9fd8-4ee5-ab88-696ced0899b3', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01dcce-8bb1-44c2-ae71-57122968885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:24 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Volume volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 (1f503317-9fd8-4ee5-ab88-696ced0899b3): created successfully Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01dcce-8bb1-44c2-ae71-57122968885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Flow 'volume_create_manager' (80518384-d344-4cb3-8054-319e8ffc63ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:24 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-01be8049-dc7c-4e27-b5c2-44621ebf631c tempest-ProjectReaderTests-436267873 None] Created volume successfully. Aug 04 12:38:24 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" returned: 0 in 0.430s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:24 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f Aug 04 12:38:24 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:24 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-ad6f2c88-c608-47f5-9109-13d14ae11273-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "cinder-ad6f2c88-c608-47f5-9109-13d14ae11273-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-quobyte-ad6f2c88-c608-47f5-9109-13d14ae11273" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-ad6f2c88-c608-47f5-9109-13d14ae11273" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcef2c-705d-4670-b229-937a000fcf23]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:25 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" returned: 0 in 0.322s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:25 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 Aug 04 12:38:25 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a26c6add-4aee-4cb0-9c9d-d0c247899d0f" released by "delete_volume" :: held 0.820s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Created reservations ['66e303a9-8819-4c02-a961-775a4fa1033e', '9615e143-2b6f-45e2-858d-d3fa38953e67', 'c2bf8de2-0b56-42a2-a09c-b5cb954c8e0a', '1bf0870c-263c-45a2-836e-dd5d023b9243'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:25 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:25 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:25 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273" returned: 0 in 0.568s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:25 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273 Aug 04 12:38:25 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:25 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.374s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a75de1a7-05ce-4a93-929e-de76b0f660d0 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a26c6add-4aee-4cb0-9c9d-d0c247899d0f-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Acquiring lock "cinder-1f503317-9fd8-4ee5-ab88-696ced0899b3-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:25 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "cinder-1f503317-9fd8-4ee5-ab88-696ced0899b3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Acquiring lock "cinder-quobyte-1f503317-9fd8-4ee5-ab88-696ced0899b3" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "cinder-quobyte-1f503317-9fd8-4ee5-ab88-696ced0899b3" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a665b-a3e1-450b-b4ef-b87f5dfbf6f5]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:26 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ad6f2c88-c608-47f5-9109-13d14ae11273" returned: 0 in 0.546s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-ad6f2c88-c608-47f5-9109-13d14ae11273" released by "delete_volume" :: held 1.167s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:26 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 Aug 04 12:38:26 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (34b0bcf7-34ea-4fc0-97f2-5448feb64573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addbd5fd-b843-4de1-802b-40926885fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addbd5fd-b843-4de1-802b-40926885fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284797344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37265676-f0b1-4f64-b520-a4df574a3710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:26Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc86d9d-ec37-4160-abb5-0392ba574f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc86d9d-ec37-4160-abb5-0392ba574f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebabecfc-0f50-4297-83b5-b21cf37355b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebabecfc-0f50-4297-83b5-b21cf37355b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37265676-f0b1-4f64-b520-a4df574a3710', 'volume_name': 'volume-37265676-f0b1-4f64-b520-a4df574a3710', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515a51df-09cb-4a8d-ada1-d23c167d10f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515a51df-09cb-4a8d-ada1-d23c167d10f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354fc9e4-4f5e-43a4-b545-36d7e91d9707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:26 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Volume 37265676-f0b1-4f64-b520-a4df574a3710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37265676-f0b1-4f64-b520-a4df574a3710', 'volume_size': 1} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284797344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37265676-f0b1-4f64-b520-a4df574a3710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:26Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Creating volume 37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:26 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:26 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 1073741824 Aug 04 12:38:26 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Created reservations ['35064e35-aba1-423f-a7ed-5b497ccfd79c', 'af240a80-d7a9-44dc-b683-7c335da1bb83', 'b791c108-d786-47b7-8dd1-01143e015940', '8be7087a-d365-4aa9-8931-2fbed6456b2d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:26 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3" returned: 0 in 0.467s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:26 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:26 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:26 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3 Aug 04 12:38:26 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:26 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.292s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:26 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Deleted volume successfully. Aug 04 12:38:26 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-98fa5dcc-52f0-47fd-8ac8-51b4c8cf0a8b tempest-ProjectReaderTests-1931115641 None] Lock "cinder-ad6f2c88-c608-47f5-9109-13d14ae11273-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 1073741824" returned: 0 in 0.548s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:26 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-1f503317-9fd8-4ee5-ab88-696ced0899b3" returned: 0 in 0.352s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "cinder-quobyte-1f503317-9fd8-4ee5-ab88-696ced0899b3" released by "delete_volume" :: held 0.881s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:26 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 Aug 04 12:38:26 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Created reservations ['d283d01e-d040-44ea-9c2b-35444d8b9ba7', '0be8a3df-1fb5-4175-a162-36b8571e75cf', 'ba03779a-38b7-410f-9555-5caaa2e2fa7e', '0a42621c-0f7e-4124-845f-a3a67fb44251'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:27 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:27 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:27 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710" returned: 0 in 0.317s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354fc9e4-4f5e-43a4-b545-36d7e91d9707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37265676-f0b1-4f64-b520-a4df574a3710', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187280a1-fc1c-40dd-b714-4225fc5ea9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Volume volume-37265676-f0b1-4f64-b520-a4df574a3710 (37265676-f0b1-4f64-b520-a4df574a3710): created successfully Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187280a1-fc1c-40dd-b714-4225fc5ea9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (34b0bcf7-34ea-4fc0-97f2-5448feb64573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b50204ad-54cf-4de8-a2e8-0458f4f941f2 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:38:27 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.327s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Deleted volume successfully. Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e13cea0c-2ab6-4100-9605-6b24e717e930 tempest-ProjectReaderTests-436267873 None] Lock "cinder-1f503317-9fd8-4ee5-ab88-696ced0899b3-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (dca0353a-8a31-46b0-a1a3-bf89fea868e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef35e5c-82d4-4c29-b886-3a4f8f0825df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef35e5c-82d4-4c29-b886-3a4f8f0825df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484140501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecdccc0-ad02-4400-8ec2-e1ed4c587d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:28Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297021f5-147a-479a-bba6-a5f575406c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297021f5-147a-479a-bba6-a5f575406c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608a984d-b685-4684-b287-15e62a512238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608a984d-b685-4684-b287-15e62a512238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecdccc0-ad02-4400-8ec2-e1ed4c587d47', 'volume_name': 'volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377f236c-e5e8-429e-94a5-2d1a685e9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377f236c-e5e8-429e-94a5-2d1a685e9139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae975021-a572-4b0c-99c3-ef262910e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:27 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Volume eecdccc0-ad02-4400-8ec2-e1ed4c587d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47', 'volume_size': 1} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484140501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecdccc0-ad02-4400-8ec2-e1ed4c587d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:28Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Creating volume eecdccc0-ad02-4400-8ec2-e1ed4c587d47 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:27 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:27 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 1073741824 Aug 04 12:38:27 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:28 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 1073741824" returned: 0 in 0.549s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:28 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 Aug 04 12:38:28 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Flow 'volume_create_manager' (db83f03e-cb46-462f-ab6c-93004dd75669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b6891-f40e-4f63-8fd1-bae0284312e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b6891-f40e-4f63-8fd1-bae0284312e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340027202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f3f734-dfad-4a8b-bd25-9c8f5c0698c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925a6b6cc9e646be924d7b6eb2e49a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:29Z,use_quota=True,user_id='7f63febb8290480291864a09d13a63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b6f3b-46ae-41f5-b666-0752c61917e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b6f3b-46ae-41f5-b666-0752c61917e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db411063-4200-4c6d-bf44-2ec687d28b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db411063-4200-4c6d-bf44-2ec687d28b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f3f734-dfad-4a8b-bd25-9c8f5c0698c2', 'volume_name': 'volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdcf4f7-4111-415c-ba46-073d8b511013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdcf4f7-4111-415c-ba46-073d8b511013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936d519c-7fdc-4eb3-8b87-2c0fffc96b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Volume 88f3f734-dfad-4a8b-bd25-9c8f5c0698c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2', 'volume_size': 1} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" returned: 0 in 0.387s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.340s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot 2e895c42-ef3c-4554-a396-dcfa06495c05 of volume 37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae975021-a572-4b0c-99c3-ef262910e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2503b01a-ee71-4266-8613-7e00ea9b7df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b638ef4b-3833-49cb-a434-1dc729f2a129]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:28 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Volume volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 (eecdccc0-ad02-4400-8ec2-e1ed4c587d47): created successfully Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2503b01a-ee71-4266-8613-7e00ea9b7df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:28 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (dca0353a-8a31-46b0-a1a3-bf89fea868e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:28 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1a5e204b-e1be-423e-a3fc-257928bfa601 tempest-ProjectReaderTests-1931115641 None] Created volume successfully. Aug 04 12:38:29 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 Aug 04 12:38:29 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710" returned: 0 in 0.377s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:29 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:29 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 1G Aug 04 12:38:29 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:29 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 1G" returned: 0 in 0.428s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37265676-f0b1-4f64-b520-a4df574a3710 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:29 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37265676-f0b1-4f64-b520-a4df574a3710 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 Aug 04 12:38:29 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-eecdccc0-ad02-4400-8ec2-e1ed4c587d47-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-eecdccc0-ad02-4400-8ec2-e1ed4c587d47-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-quobyte-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:30 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37265676-f0b1-4f64-b520-a4df574a3710 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 is being set with open permissions: ugo+rw Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc06d88-ce71-4320-ac44-c885fdd81a1b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 Aug 04 12:38:30 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 Aug 04 12:38:30 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info Aug 04 12:38:30 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" returned: 0 in 0.406s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47 Aug 04 12:38:30 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info is being set with open permissions: ugo+rw Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info Aug 04 12:38:30 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" returned: 0 in 0.279s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-eecdccc0-ad02-4400-8ec2-e1ed4c587d47" released by "delete_volume" :: held 0.743s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Created reservations ['79a5f926-0e28-4919-a562-49746719ab79', '59a45d32-cd65-4c2b-b398-a7f58d8691ce', 'bed34f1b-0e80-4d9b-b13e-36b34705d9e2', '8c8b9f3d-75ef-4176-883b-7f0cf2471c5c'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:30 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.info" returned: 0 in 0.294s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:30 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:30 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.110s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340027202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f3f734-dfad-4a8b-bd25-9c8f5c0698c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925a6b6cc9e646be924d7b6eb2e49a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:29Z,use_quota=True,user_id='7f63febb8290480291864a09d13a63a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Creating volume 88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:30 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:30 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:31 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 1073741824 Aug 04 12:38:31 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-913c375c-d8cb-4c3e-87fe-f365728c3a03 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.338s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:31 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Deleted volume successfully. Aug 04 12:38:31 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-83d24b5e-164c-49dd-9c62-18ad3fd32936 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-eecdccc0-ad02-4400-8ec2-e1ed4c587d47-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (d5ed5826-f455-4691-8fa5-aeda4f021fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f58cca-bb2b-4637-a97c-0e9a710858c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f58cca-bb2b-4637-a97c-0e9a710858c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537328523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69aa62f3-afb3-40f9-ae62-1ddbe910a041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:31Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e6bd18-085c-43b3-ae67-fb1d1b087e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e6bd18-085c-43b3-ae67-fb1d1b087e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c649172-d74f-4d25-845d-6ac248f9907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c649172-d74f-4d25-845d-6ac248f9907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69aa62f3-afb3-40f9-ae62-1ddbe910a041', 'volume_name': 'volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4458a8-7cea-483c-8fcc-30b262f87ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4458a8-7cea-483c-8fcc-30b262f87ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ffd1b-3d23-4c9d-890e-55c3f7419b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Volume 69aa62f3-afb3-40f9-ae62-1ddbe910a041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041', 'volume_size': 1} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:31 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 1073741824" returned: 0 in 0.685s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-2e895c42-ef3c-4554-a396-dcfa06495c05-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-2e895c42-ef3c-4554-a396-dcfa06495c05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-2e895c42-ef3c-4554-a396-dcfa06495c05" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-2e895c42-ef3c-4554-a396-dcfa06495c05" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot 2e895c42-ef3c-4554-a396-dcfa06495c05 of volume 37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c5870-39e6-4ecb-9a24-7dfe0853c0dd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:31 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 Aug 04 12:38:31 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (5ffbcf50-9dd4-42a5-89b1-0e34626b66e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b566e4-e91a-4ef8-84a3-064d1161ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:31 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b566e4-e91a-4ef8-84a3-064d1161ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389471199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e2250c-8972-4eb5-b727-6bb06ea7137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:32Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcd8e56-e0be-4856-8bbd-8093cb28fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcd8e56-e0be-4856-8bbd-8093cb28fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 Aug 04 12:38:32 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52bf3dc-99f4-4e80-8caf-2acc3cc51073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52bf3dc-99f4-4e80-8caf-2acc3cc51073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e2250c-8972-4eb5-b727-6bb06ea7137e', 'volume_name': 'volume-76e2250c-8972-4eb5-b727-6bb06ea7137e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a896f4-fae8-453a-9025-61b05fcfb52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a896f4-fae8-453a-9025-61b05fcfb52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa423e4-972f-44c2-999a-3ef6ae47d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Volume 76e2250c-8972-4eb5-b727-6bb06ea7137e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e2250c-8972-4eb5-b727-6bb06ea7137e', 'volume_size': 1} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:32 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" returned: 0 in 0.294s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537328523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69aa62f3-afb3-40f9-ae62-1ddbe910a041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:31Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Creating volume 69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936d519c-7fdc-4eb3-8b87-2c0fffc96b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06559d5-129a-4443-bee9-3f2b02fe6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 1073741824 Aug 04 12:38:32 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Volume volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 (88f3f734-dfad-4a8b-bd25-9c8f5c0698c2): created successfully Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06559d5-129a-4443-bee9-3f2b02fe6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Flow 'volume_create_manager' (db83f03e-cb46-462f-ab6c-93004dd75669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-938dbca3-94e1-4907-9ca9-4bd4598cbe8e tempest-ProjectReaderTests-436267873 None] Created volume successfully. Aug 04 12:38:32 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05" returned: 0 in 0.400s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37265676-f0b1-4f64-b520-a4df574a3710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd43b241-ab3c-40f1-a4a7-ee7b25915b09]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:32 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 Aug 04 12:38:32 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 1073741824" returned: 0 in 0.416s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:32 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 Aug 04 12:38:32 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710" returned: 0 in 0.401s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:32 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 Aug 04 12:38:32 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041" returned: 0 in 0.267s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389471199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e2250c-8972-4eb5-b727-6bb06ea7137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e18c9bbeb443bbd954fb46e77f69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:32Z,use_quota=True,user_id='57ec2525311a45b4951427eb6e088c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Creating volume 76e2250c-8972-4eb5-b727-6bb06ea7137e {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ffd1b-3d23-4c9d-890e-55c3f7419b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e 1073741824 Aug 04 12:38:32 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6c54d-ddef-4bbc-9235-0364441ea8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Volume volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 (69aa62f3-afb3-40f9-ae62-1ddbe910a041): created successfully Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6c54d-ddef-4bbc-9235-0364441ea8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:32 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (d5ed5826-f455-4691-8fa5-aeda4f021fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:32 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7cca7cc5-647d-46e0-8a1d-142a701927b2 tempest-ProjectReaderTests-1153750780 None] Created volume successfully. Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Acquiring lock "cinder-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "cinder-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Acquiring lock "cinder-quobyte-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "cinder-quobyte-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdefded2-d927-4ac7-bf06-b523a451e279]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:33 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05" returned: 0 in 0.429s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:33 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05 Aug 04 12:38:33 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:33 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 Aug 04 12:38:33 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:33 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e 1073741824" returned: 0 in 0.496s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710.2e895c42-ef3c-4554-a396-dcfa06495c05" returned: 0 in 0.275s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-2e895c42-ef3c-4554-a396-dcfa06495c05" released by "_delete_snapshot" :: held 1.663s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" released by "delete_snapshot" :: held 1.696s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:33 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e Aug 04 12:38:33 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Created reservations ['61290ed5-0615-4cd2-8bc1-cf670ed5803a', '18151926-f249-4f96-9cac-595ab664655f', '1277241c-260d-40bb-8b2d-b95c9bbd4ce7', 'bab16fa1-257a-4cc5-a5fb-28cb2e1c31eb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:33 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" returned: 0 in 0.455s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:33 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2 Aug 04 12:38:33 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-30192cf9-6ffe-468d-9c54-2f73c7bfecef tempest-ProjectMemberTests-1882375512 None] Lock "cinder-2e895c42-ef3c-4554-a396-dcfa06495c05-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:33 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e" returned: 0 in 0.301s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa423e4-972f-44c2-999a-3ef6ae47d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e2250c-8972-4eb5-b727-6bb06ea7137e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790b9d4d-5b9f-486d-9d51-6aab33987f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Creating offline snapshot 0ba356dd-7e71-40e2-b755-ada1ab89e8fa of volume 69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:33 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Volume volume-76e2250c-8972-4eb5-b727-6bb06ea7137e (76e2250c-8972-4eb5-b727-6bb06ea7137e): created successfully Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790b9d4d-5b9f-486d-9d51-6aab33987f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Flow 'volume_create_manager' (5ffbcf50-9dd4-42a5-89b1-0e34626b66e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc81936-dfef-4e11-9a1c-a5a2fad1e483]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:33 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-92b1faa8-7bc1-496a-8edc-35eaa03231d5 tempest-ProjectReaderTests-1931115641 None] Created volume successfully. Aug 04 12:38:33 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" returned: 0 in 0.325s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "cinder-quobyte-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2" released by "delete_volume" :: held 0.833s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:33 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 Aug 04 12:38:33 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:33 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Created reservations ['019205c5-a83f-4331-9311-ee0b127beecf', 'b4d2906a-293d-4f21-922c-5c775f288df5', '73b529b3-51e8-4815-89d3-fe24a8130a16', '0a63803e-1d90-44f7-97cf-c9f6b35b0f55'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-37265676-f0b1-4f64-b520-a4df574a3710-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-37265676-f0b1-4f64-b520-a4df574a3710-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:34 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:34 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d24dbe-94b4-42a4-9edf-95cc5727473b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:34 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:34 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 Aug 04 12:38:34 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041" returned: 0 in 0.465s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:34 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa 1G Aug 04 12:38:34 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:34 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.309s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:34 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Deleted volume successfully. Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-47b3f8b1-b19c-4a33-9440-65be8adfde88 tempest-ProjectReaderTests-436267873 None] Lock "cinder-88f3f734-dfad-4a8b-bd25-9c8f5c0698c2-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:34 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710" returned: 0 in 0.456s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:34 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710 Aug 04 12:38:34 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:34 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa 1G" returned: 0 in 0.559s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:34 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa Aug 04 12:38:34 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:34 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:34 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-37265676-f0b1-4f64-b520-a4df574a3710" returned: 0 in 0.343s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-37265676-f0b1-4f64-b520-a4df574a3710" released by "delete_volume" :: held 0.890s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-76e2250c-8972-4eb5-b727-6bb06ea7137e-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-76e2250c-8972-4eb5-b727-6bb06ea7137e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "cinder-quobyte-76e2250c-8972-4eb5-b727-6bb06ea7137e" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Created reservations ['6da15cd8-a749-4b4e-aa0c-1f2d9d2461db', '776952f4-91a9-40a6-951c-8871b6746298', '7c792b69-d6bf-470f-85b6-aa853e437bfe', '7033c2a6-b5bd-48c1-a62b-a41fafc99c92'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-76e2250c-8972-4eb5-b727-6bb06ea7137e" acquired by "delete_volume" :: waited 0.046s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45cc3c-3842-4bd9-bd7a-919bcfbde271]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:35 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa" returned: 0 in 0.431s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:35 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa is being set with open permissions: ugo+rw Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:35 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:35 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:35 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa Aug 04 12:38:35 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:35 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e Aug 04 12:38:35 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:35 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:35 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.390s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa" returned: 0 in 0.375s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:35 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:35 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e" returned: 0 in 0.493s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:35 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e Aug 04 12:38:35 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:35 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3f2dcf2f-b8a1-4b5b-887b-c9339e02c463 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-37265676-f0b1-4f64-b520-a4df574a3710-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:35 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info Aug 04 12:38:35 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:36 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-76e2250c-8972-4eb5-b727-6bb06ea7137e" returned: 0 in 0.288s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-quobyte-76e2250c-8972-4eb5-b727-6bb06ea7137e" released by "delete_volume" :: held 0.846s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:36 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info" returned: 0 in 0.320s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:36 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info is being set with open permissions: ugo+rw Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:36 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info Aug 04 12:38:36 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Created reservations ['f446eb58-810d-463d-8527-6dd3f8b2bbdd', '40242250-cea9-4687-8d87-387c55daa709', '29f9c6b8-4290-483f-b2cb-e9b1e40b7309', 'f4c84752-3cc7-481b-a9e7-c447e4d972f8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:36 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:36 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:36 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.info" returned: 0 in 0.348s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b3356746-b8f9-4684-aa22-34e3e96aad27 tempest-ProjectReaderTests-1153750780 None] Create snapshot completed successfully Aug 04 12:38:36 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:36 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Deleted volume successfully. Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-f9ae2d5d-a08f-402d-8a8a-84a9d4c3ded3 tempest-ProjectReaderTests-1931115641 None] Lock "cinder-76e2250c-8972-4eb5-b727-6bb06ea7137e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (50230489-90c2-4055-a368-9c5cb02cd9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:36 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4aafe7-23ff-4f4d-b9b3-3bc49e1afb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4aafe7-23ff-4f4d-b9b3-3bc49e1afb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147627838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197615f-6677-464c-a89d-d5f409a2bfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:37Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bee817-8620-441c-9a9e-d805842db16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bee817-8620-441c-9a9e-d805842db16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277677d3-5d8c-4431-bcbb-6fb1f4eb00d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277677d3-5d8c-4431-bcbb-6fb1f4eb00d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7197615f-6677-464c-a89d-d5f409a2bfae', 'volume_name': 'volume-7197615f-6677-464c-a89d-d5f409a2bfae', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f9379-a55e-4fd4-a254-38856f932974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f9379-a55e-4fd4-a254-38856f932974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5abaecf-014e-4818-a532-f20ab019c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:37 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Volume 7197615f-6677-464c-a89d-d5f409a2bfae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7197615f-6677-464c-a89d-d5f409a2bfae', 'volume_size': 1} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147627838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197615f-6677-464c-a89d-d5f409a2bfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:37Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Creating volume 7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:37 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:37 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae 1073741824 Aug 04 12:38:37 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-0ba356dd-7e71-40e2-b755-ada1ab89e8fa-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-0ba356dd-7e71-40e2-b755-ada1ab89e8fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-0ba356dd-7e71-40e2-b755-ada1ab89e8fa" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-0ba356dd-7e71-40e2-b755-ada1ab89e8fa" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Deleting offline snapshot 0ba356dd-7e71-40e2-b755-ada1ab89e8fa of volume 69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] snapshot_file for this snap is: volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4c417-2ea5-4e6d-bd7b-6c7f3e8a54ee]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:37 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa Aug 04 12:38:37 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:37 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae 1073741824" returned: 0 in 0.561s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:37 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae Aug 04 12:38:37 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:37 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa" returned: 0 in 0.494s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c9006b-4caa-4a5e-afd3-435be47e5e3f]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:37 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:38 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae" returned: 0 in 0.409s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:38 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5abaecf-014e-4818-a532-f20ab019c040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7197615f-6677-464c-a89d-d5f409a2bfae', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:38 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cde6d3-48f3-4930-89ac-3744a596d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:38 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Volume volume-7197615f-6677-464c-a89d-d5f409a2bfae (7197615f-6677-464c-a89d-d5f409a2bfae): created successfully Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cde6d3-48f3-4930-89ac-3744a596d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (50230489-90c2-4055-a368-9c5cb02cd9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:38 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-242b72f9-8b66-4a1f-b98e-975e65c44c29 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:38:38 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041" returned: 0 in 0.468s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:38 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa Aug 04 12:38:38 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:38 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa" returned: 0 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:38 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:38 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa Aug 04 12:38:38 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:39 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041.0ba356dd-7e71-40e2-b755-ada1ab89e8fa" returned: 0 in 0.352s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-0ba356dd-7e71-40e2-b755-ada1ab89e8fa" released by "_delete_snapshot" :: held 1.832s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" released by "delete_snapshot" :: held 1.871s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot a2aa2087-a988-442b-a470-d9e6e2839ce0 of volume 7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba08dd-796a-4838-a309-6b4d7c010173]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Created reservations ['a3aa801f-c41f-4f7b-9b72-fc55ee5f9e33', 'fe8a29da-099b-43b0-94f7-d18a9469d249', '1ebc1d3d-0dde-4aef-81c9-9aff8900247d', 'cc8b4ac4-a452-4722-94ec-4dbba173a407'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:39 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae Aug 04 12:38:39 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:39 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Delete snapshot completed successfully. Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1a1ae75f-9d90-49b5-8743-c561a6985ec2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-0ba356dd-7e71-40e2-b755-ada1ab89e8fa-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-69aa62f3-afb3-40f9-ae62-1ddbe910a041-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "cinder-69aa62f3-afb3-40f9-ae62-1ddbe910a041-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42ed72-24a2-4a22-b617-828362ad60f2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:39 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae" returned: 0 in 0.428s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:39 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:39 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 1G Aug 04 12:38:39 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:39 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 Aug 04 12:38:39 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041" returned: 0 in 0.424s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:40 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041 Aug 04 12:38:40 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 1G" returned: 0 in 0.478s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7197615f-6677-464c-a89d-d5f409a2bfae -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:40 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7197615f-6677-464c-a89d-d5f409a2bfae -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 Aug 04 12:38:40 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-69aa62f3-afb3-40f9-ae62-1ddbe910a041" returned: 0 in 0.302s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-69aa62f3-afb3-40f9-ae62-1ddbe910a041" released by "delete_volume" :: held 0.797s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Created reservations ['27387fd0-e59b-4b74-a694-bf3f31908996', 'f549613b-1d5c-49c9-a6cb-fb99643072e0', '47f3bb09-d7c8-4647-8e22-08bd6b67ed9c', '27f331de-8c69-4db3-951f-3c7652967b4a'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:40 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7197615f-6677-464c-a89d-d5f409a2bfae -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0" returned: 0 in 0.327s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 is being set with open permissions: ugo+rw Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:40 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 Aug 04 12:38:40 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:40 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0" returned: 0 in 0.302s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.313s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:40 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Deleted volume successfully. Aug 04 12:38:40 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info Aug 04 12:38:40 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:40 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-fcff8b6f-9eed-431f-bce5-235999ead1ff tempest-ProjectReaderTests-1153750780 None] Lock "cinder-69aa62f3-afb3-40f9-ae62-1ddbe910a041-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:41 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:41 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info is being set with open permissions: ugo+rw Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:41 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (8cfb38b4-6873-4798-9201-fbeb190cb62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:41 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368633e0-c340-4bb4-aa26-5957ed48f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368633e0-c340-4bb4-aa26-5957ed48f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708433400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ed79d-c061-47a9-804d-dbf72d50a278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:41Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295dec86-b89e-450c-abae-ea8b31564c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295dec86-b89e-450c-abae-ea8b31564c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593bcbd-fa42-4b2b-9f75-495269766964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3593bcbd-fa42-4b2b-9f75-495269766964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756ed79d-c061-47a9-804d-dbf72d50a278', 'volume_name': 'volume-756ed79d-c061-47a9-804d-dbf72d50a278', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aada5e7-d62e-417e-ab75-d6939268f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aada5e7-d62e-417e-ab75-d6939268f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fcec28-5c3d-4e3a-9fc5-0a5a8e5cd502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:41 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Volume 756ed79d-c061-47a9-804d-dbf72d50a278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756ed79d-c061-47a9-804d-dbf72d50a278', 'volume_size': 1} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:41 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.info" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708433400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ed79d-c061-47a9-804d-dbf72d50a278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:41Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Creating volume 756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:41 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:41 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:41 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 1073741824 Aug 04 12:38:41 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:41 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-05306dab-6fae-48bf-a858-7ce357f2c129 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:38:42 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 1073741824" returned: 0 in 0.486s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:42 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 Aug 04 12:38:42 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:42 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278" returned: 0 in 0.312s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fcec28-5c3d-4e3a-9fc5-0a5a8e5cd502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756ed79d-c061-47a9-804d-dbf72d50a278', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7dad38-ac6d-44b3-bcfd-b52f5e9e608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:42 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Volume volume-756ed79d-c061-47a9-804d-dbf72d50a278 (756ed79d-c061-47a9-804d-dbf72d50a278): created successfully Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7dad38-ac6d-44b3-bcfd-b52f5e9e608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (8cfb38b4-6873-4798-9201-fbeb190cb62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:42 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-feda5701-7880-4f2a-bcad-977c7f9147a0 tempest-ProjectReaderTests-1153750780 None] Created volume successfully. Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-a2aa2087-a988-442b-a470-d9e6e2839ce0-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a2aa2087-a988-442b-a470-d9e6e2839ce0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-a2aa2087-a988-442b-a470-d9e6e2839ce0" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a2aa2087-a988-442b-a470-d9e6e2839ce0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot a2aa2087-a988-442b-a470-d9e6e2839ce0 of volume 7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ec9c1f-a361-43ba-9d58-55e9176f6939]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:42 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 Aug 04 12:38:42 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:42 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0" returned: 0 in 0.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7197615f-6677-464c-a89d-d5f409a2bfae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f64e9-b3b3-4cb9-9b8b-77982f63efa9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:42 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:43 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae Aug 04 12:38:43 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:43 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae" returned: 0 in 0.377s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:43 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 Aug 04 12:38:43 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Creating offline snapshot 83814397-c448-4509-a19d-1e2f1b75f4bf of volume 756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0412ae1d-4786-4c80-ba8d-66b111a3e740]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:43 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 Aug 04 12:38:43 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:43 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:43 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0 Aug 04 12:38:43 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:43 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:43 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:44 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae.a2aa2087-a988-442b-a470-d9e6e2839ce0" returned: 0 in 0.280s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:44 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf 1G Aug 04 12:38:44 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a2aa2087-a988-442b-a470-d9e6e2839ce0" released by "_delete_snapshot" :: held 1.546s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" released by "delete_snapshot" :: held 1.570s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Created reservations ['b1a95dd6-139b-4c40-b2a8-2f42a0cdf4ad', 'f98fe3dd-97ca-4e2d-8ef7-ed336aef5cdc', 'b0cc4fdf-fe71-4227-b792-d6f5275a6bca', '61404683-a707-4d57-b1bb-19e53ec1147f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:44 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4d34dbfd-0400-49cb-9f6f-7c5528d39713 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a2aa2087-a988-442b-a470-d9e6e2839ce0-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:44 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf 1G" returned: 0 in 0.451s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756ed79d-c061-47a9-804d-dbf72d50a278 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:44 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756ed79d-c061-47a9-804d-dbf72d50a278 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf Aug 04 12:38:44 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-7197615f-6677-464c-a89d-d5f409a2bfae-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7197615f-6677-464c-a89d-d5f409a2bfae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceee17ee-8bc2-4b7e-a677-475598059ef2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:44 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756ed79d-c061-47a9-804d-dbf72d50a278 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf" returned: 0 in 0.341s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:44 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf is being set with open permissions: ugo+rw Aug 04 12:38:44 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:44 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf Aug 04 12:38:44 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:44 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae Aug 04 12:38:44 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:45 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:45 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info Aug 04 12:38:45 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:45 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae" returned: 0 in 0.404s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:45 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae Aug 04 12:38:45 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:45 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info" returned: 0 in 0.267s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info is being set with open permissions: ugo+rw Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:45 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info Aug 04 12:38:45 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:45 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7197615f-6677-464c-a89d-d5f409a2bfae" returned: 0 in 0.291s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7197615f-6677-464c-a89d-d5f409a2bfae" released by "delete_volume" :: held 0.757s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Created reservations ['93694aa4-310f-4e3d-a357-5fcf8386d16f', '319cbbbe-2fb3-422f-97a3-ce4352e57ef6', '5c0094d5-d8b4-4af5-91c5-b7e7461631aa', '6b508ca8-de63-47f8-a30d-fd69ae1103df'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:45 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.info" returned: 0 in 0.270s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:45 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e7528f7d-4e53-474d-94c0-b22593c08bd7 tempest-ProjectReaderTests-1153750780 None] Create snapshot completed successfully Aug 04 12:38:45 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:45 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:38:45 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0bcc6ded-625b-4860-a877-3a1481580dfa tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7197615f-6677-464c-a89d-d5f409a2bfae-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (6447b30c-e89b-4aac-9920-bb7d47a0319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4933e19-eca1-4ca4-92b2-bb1f836e188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4933e19-eca1-4ca4-92b2-bb1f836e188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491332129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354688f-19e3-4ea7-9929-60e5d5f3341d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:46Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdcd47a-70da-4aa3-8005-b115165c1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdcd47a-70da-4aa3-8005-b115165c1167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca708c4-a401-4fca-aa20-254de20a5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca708c4-a401-4fca-aa20-254de20a5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4354688f-19e3-4ea7-9929-60e5d5f3341d', 'volume_name': 'volume-4354688f-19e3-4ea7-9929-60e5d5f3341d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb96c5b1-d8e9-4fd5-aeb2-145a6d7dba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb96c5b1-d8e9-4fd5-aeb2-145a6d7dba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9ed5ff-e198-4c33-9830-3516cf88e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:46 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Volume 4354688f-19e3-4ea7-9929-60e5d5f3341d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4354688f-19e3-4ea7-9929-60e5d5f3341d', 'volume_size': 1} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491332129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354688f-19e3-4ea7-9929-60e5d5f3341d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:46Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Creating volume 4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:46 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:46 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d 1073741824 Aug 04 12:38:46 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-83814397-c448-4509-a19d-1e2f1b75f4bf-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-83814397-c448-4509-a19d-1e2f1b75f4bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-83814397-c448-4509-a19d-1e2f1b75f4bf" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-83814397-c448-4509-a19d-1e2f1b75f4bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Deleting offline snapshot 83814397-c448-4509-a19d-1e2f1b75f4bf of volume 756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] snapshot_file for this snap is: volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205c12a-d992-4ba1-94a7-1cc976bb9ba4]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:46 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:46 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d 1073741824" returned: 0 in 0.534s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:46 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:46 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:47 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d Aug 04 12:38:47 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:47 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf" returned: 0 in 0.389s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-756ed79d-c061-47a9-804d-dbf72d50a278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9af51a-f1b0-49e5-9c49-0a21f6a358a8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:47 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9ed5ff-e198-4c33-9830-3516cf88e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4354688f-19e3-4ea7-9929-60e5d5f3341d', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea1502-2651-44e3-b178-d09f5c5c90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:47 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Volume volume-4354688f-19e3-4ea7-9929-60e5d5f3341d (4354688f-19e3-4ea7-9929-60e5d5f3341d): created successfully Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea1502-2651-44e3-b178-d09f5c5c90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (6447b30c-e89b-4aac-9920-bb7d47a0319b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:47 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-06c2105d-43dc-4537-bffc-f7be2aa0647f tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:38:47 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 Aug 04 12:38:47 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:47 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:47 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf Aug 04 12:38:47 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:47 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf" returned: 0 in 0.313s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:47 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:47 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf Aug 04 12:38:47 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:48 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278.83814397-c448-4509-a19d-1e2f1b75f4bf" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-83814397-c448-4509-a19d-1e2f1b75f4bf" released by "_delete_snapshot" :: held 1.401s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" released by "delete_snapshot" :: held 1.428s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Created reservations ['0d2aea8f-71f1-4f4c-974b-67930621fafe', '5c7ccb13-7357-4ecd-a955-18c40c0fdf12', '4bf7b088-d315-4aff-94d2-2087c2116ba7', 'd3ddf1e8-ee9e-4d44-b6e8-2d5624573945'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:48 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Delete snapshot completed successfully. Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-673f3359-18dd-45aa-8b56-ff2f5c83b288 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-83814397-c448-4509-a19d-1e2f1b75f4bf-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot a0415b3e-31cb-4612-a5d8-461d1878fbe6 of volume 4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1ea43-d216-4b09-9b28-ce543f0f0fc8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:48 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d Aug 04 12:38:48 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-756ed79d-c061-47a9-804d-dbf72d50a278-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:48 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d" returned: 0 in 0.362s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-756ed79d-c061-47a9-804d-dbf72d50a278-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:48 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 1G Aug 04 12:38:48 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:48 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" acquired by "delete_volume" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e0d0a-ad2f-4d2f-b013-1dfd2feef491]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 Aug 04 12:38:49 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:49 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 1G" returned: 0 in 0.432s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4354688f-19e3-4ea7-9929-60e5d5f3341d -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4354688f-19e3-4ea7-9929-60e5d5f3341d -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 Aug 04 12:38:49 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:49 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278" returned: 0 in 0.380s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278 Aug 04 12:38:49 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:49 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4354688f-19e3-4ea7-9929-60e5d5f3341d -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6" returned: 0 in 0.290s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:49 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 is being set with open permissions: ugo+rw Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-756ed79d-c061-47a9-804d-dbf72d50a278" returned: 0 in 0.247s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:49 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 Aug 04 12:38:49 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-756ed79d-c061-47a9-804d-dbf72d50a278" released by "delete_volume" :: held 0.686s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Created reservations ['4d4b6a33-aaf7-439c-ad7a-b8336e2f64df', 'efab4126-70e8-4386-87eb-f606fc022250', '5deb900e-a6ea-4c9c-8928-eaaf46f9e367', '426d6fba-5cfe-45cb-93f7-56e98cd409f1'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:49 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:49 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:49 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:49 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info Aug 04 12:38:49 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:50 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Deleted volume successfully. Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-78ac6a42-fd07-4941-8a0d-7d2bc7f81a24 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-756ed79d-c061-47a9-804d-dbf72d50a278-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:50 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:50 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info is being set with open permissions: ugo+rw Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:50 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info Aug 04 12:38:50 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:50 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.info" returned: 0 in 0.259s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:50 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-f5ad8aba-5322-449f-85fc-cae7d24422b0 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (9514c653-b64b-4a0e-a1f3-635b7fa7197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408d4b49-dff3-4e7d-a53e-9ec37103b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408d4b49-dff3-4e7d-a53e-9ec37103b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672951871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:51Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe44fbe-26fd-4610-9f90-8eebd81cdc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe44fbe-26fd-4610-9f90-8eebd81cdc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826e3e77-ac28-4b69-8c47-e6fff2e76459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826e3e77-ac28-4b69-8c47-e6fff2e76459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8', 'volume_name': 'volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9658b-bf7e-4325-a945-321ef46a71b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9658b-bf7e-4325-a945-321ef46a71b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8994c164-44ef-4de9-beab-64f7b89bd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:50 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Volume dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8', 'volume_size': 1} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672951871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:51Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Creating volume dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:50 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:50 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 1073741824 Aug 04 12:38:50 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-a0415b3e-31cb-4612-a5d8-461d1878fbe6-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a0415b3e-31cb-4612-a5d8-461d1878fbe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-a0415b3e-31cb-4612-a5d8-461d1878fbe6" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a0415b3e-31cb-4612-a5d8-461d1878fbe6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot a0415b3e-31cb-4612-a5d8-461d1878fbe6 of volume 4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c1890d-f859-4638-89b3-2f212051d94a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:50 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:50 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 Aug 04 12:38:50 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:51 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 1073741824" returned: 0 in 0.409s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:51 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 Aug 04 12:38:51 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:51 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4354688f-19e3-4ea7-9929-60e5d5f3341d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3378ead-7fce-4f65-b2e4-d0a9031271fe]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:51 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d Aug 04 12:38:51 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:51 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" returned: 0 in 0.260s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8994c164-44ef-4de9-beab-64f7b89bd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95664bcc-4fb8-4845-9f06-cece78661766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:51 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Volume volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 (dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8): created successfully Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95664bcc-4fb8-4845-9f06-cece78661766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (9514c653-b64b-4a0e-a1f3-635b7fa7197b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:51 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-177f1f33-b95b-4176-ae59-2d047962c7be tempest-ProjectReaderTests-1153750780 None] Created volume successfully. Aug 04 12:38:51 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:51 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 Aug 04 12:38:51 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Creating offline snapshot 575e92f4-a17b-42c8-89bb-2573d814a7b3 of volume dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dce270-bea7-401c-991e-c68668e9f55d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:51 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 Aug 04 12:38:51 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:51 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:51 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:51 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6 Aug 04 12:38:51 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:52 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" returned: 0 in 0.362s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:52 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 1G Aug 04 12:38:52 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:52 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d.a0415b3e-31cb-4612-a5d8-461d1878fbe6" returned: 0 in 0.254s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a0415b3e-31cb-4612-a5d8-461d1878fbe6" released by "_delete_snapshot" :: held 1.444s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" released by "delete_snapshot" :: held 1.465s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Created reservations ['6000b3d0-66ac-418c-a7ac-9d8d82d99622', '7df70cda-0893-4512-bf70-6d1e1beed276', '8b2959fc-2a54-4e4d-80a2-8be03dc5ffb1', '894b800e-5904-44e1-9177-4768019d88d2'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:52 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3d23d63e-00ff-4e80-90ba-efb2bcea287a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a0415b3e-31cb-4612-a5d8-461d1878fbe6-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:52 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 1G" returned: 0 in 0.397s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:52 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 Aug 04 12:38:52 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:52 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3" returned: 0 in 0.308s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:52 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 is being set with open permissions: ugo+rw Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-4354688f-19e3-4ea7-9929-60e5d5f3341d-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:52 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 Aug 04 12:38:52 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-4354688f-19e3-4ea7-9929-60e5d5f3341d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7da762-2a12-438b-aec3-28645907ffed]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:52 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3" returned: 0 in 0.243s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info Aug 04 12:38:53 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:53 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d" returned: 0 in 0.358s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d Aug 04 12:38:53 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:53 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info" returned: 0 in 0.265s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info is being set with open permissions: ugo+rw Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info Aug 04 12:38:53 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:53 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-4354688f-19e3-4ea7-9929-60e5d5f3341d" returned: 0 in 0.251s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4354688f-19e3-4ea7-9929-60e5d5f3341d" released by "delete_volume" :: held 0.668s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:53 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.info" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e1cd7cb8-65d9-438a-8860-bfbe5a5723cb tempest-ProjectReaderTests-1153750780 None] Create snapshot completed successfully Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Created reservations ['40d9562c-2a82-471e-9719-ff49fb54173b', 'c526696b-f655-4a9e-a3fc-d4640b9d7a43', '3815e77e-0cdf-4916-ac23-574926fee6f3', 'b226918c-42a9-4331-bac0-68963e4d9e53'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:53 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-575e92f4-a17b-42c8-89bb-2573d814a7b3-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-575e92f4-a17b-42c8-89bb-2573d814a7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-575e92f4-a17b-42c8-89bb-2573d814a7b3" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-575e92f4-a17b-42c8-89bb-2573d814a7b3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Deleting offline snapshot 575e92f4-a17b-42c8-89bb-2573d814a7b3 of volume dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] snapshot_file for this snap is: volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ade76-dfed-4e82-84aa-bade7470d38d]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:53 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:53 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:53 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-15a8e688-eb00-4878-a83d-b06b847ba2e9 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-4354688f-19e3-4ea7-9929-60e5d5f3341d-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:54 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 Aug 04 12:38:54 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:54 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b291462-ee89-4902-93c3-3ec5c28e3351]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (8280ed61-83bd-498a-8907-b4c4f1d621ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de104814-98f2-42a5-8faa-fe1a52f20717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de104814-98f2-42a5-8faa-fe1a52f20717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109906905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6794e8-f9d3-4c79-a743-263de921a589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:54Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:54 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210dce46-75a8-4d04-bacc-a7313a55a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:54 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210dce46-75a8-4d04-bacc-a7313a55a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359042de-d599-42ba-8d17-b357e5a553b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359042de-d599-42ba-8d17-b357e5a553b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6794e8-f9d3-4c79-a743-263de921a589', 'volume_name': 'volume-ac6794e8-f9d3-4c79-a743-263de921a589', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8a978-97b5-46ef-8825-5e8caacd12bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8a978-97b5-46ef-8825-5e8caacd12bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba55de-0c40-4b6b-aa29-7f2eb527a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:54 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Volume ac6794e8-f9d3-4c79-a743-263de921a589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6794e8-f9d3-4c79-a743-263de921a589', 'volume_size': 1} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109906905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6794e8-f9d3-4c79-a743-263de921a589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:54Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Creating volume ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:54 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:54 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 1073741824 Aug 04 12:38:54 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:54 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:54 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 Aug 04 12:38:54 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:54 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:54 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 1073741824" returned: 0 in 0.420s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:55 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 Aug 04 12:38:55 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:55 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3" returned: 0 in 0.351s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:55 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3 Aug 04 12:38:55 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:55 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ba55de-0c40-4b6b-aa29-7f2eb527a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6794e8-f9d3-4c79-a743-263de921a589', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab9be29-a594-46e1-8fe1-fc3c872293e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:55 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Volume volume-ac6794e8-f9d3-4c79-a743-263de921a589 (ac6794e8-f9d3-4c79-a743-263de921a589): created successfully Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab9be29-a594-46e1-8fe1-fc3c872293e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (8280ed61-83bd-498a-8907-b4c4f1d621ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-2362899d-d994-47a4-952c-572b623c4a7b tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:38:55 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8.575e92f4-a17b-42c8-89bb-2573d814a7b3" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-575e92f4-a17b-42c8-89bb-2573d814a7b3" released by "_delete_snapshot" :: held 1.481s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" released by "delete_snapshot" :: held 1.505s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Created reservations ['c9b3316a-ece2-439e-adde-5ad079a0b242', '1a3dede4-495d-487a-8d2b-af9a5e774b62', 'd50e03a1-b57b-4688-9868-58bd42642796', '7023901f-f196-40c1-86c8-869522b7f725'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:55 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Delete snapshot completed successfully. Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-4e4fe7ad-dffc-45ff-b0a8-93c70db3a495 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-575e92f4-a17b-42c8-89bb-2573d814a7b3-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot 5c662694-16ea-4b0a-b330-3320ca4ab5c4 of volume ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf02e9fc-ccaa-4c3c-8445-ebf3b5e31917]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:55 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:55 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 Aug 04 12:38:55 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589" returned: 0 in 0.365s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 1G Aug 04 12:38:56 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" acquired by "delete_volume" :: waited 0.021s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cacdd-cdb7-4efb-af1e-1aba4a857b3b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 Aug 04 12:38:56 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 1G" returned: 0 in 0.416s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6794e8-f9d3-4c79-a743-263de921a589 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6794e8-f9d3-4c79-a743-263de921a589 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 Aug 04 12:38:56 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" returned: 0 in 0.373s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8 Aug 04 12:38:56 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6794e8-f9d3-4c79-a743-263de921a589 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4" returned: 0 in 0.278s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:56 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 is being set with open permissions: ugo+rw Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 Aug 04 12:38:56 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8" released by "delete_volume" :: held 0.687s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Created reservations ['81c274c4-771a-4390-9517-8cf872e1b2ed', '2b7b8c1d-abef-457e-aeb9-ff06650faa86', '0a049577-6e5e-4645-9ebd-320fe920df78', '3cb75226-b1c6-42e0-bf1d-20c6a97238b4'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:56 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:38:56 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:56 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4" returned: 0 in 0.252s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:57 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info Aug 04 12:38:57 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:57 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.271s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:38:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Deleted volume successfully. Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d9fe29be-9511-4ab2-a295-b2ee3c470909 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-dc8bc3bb-9e9f-4b6c-bd38-63f5964092a8-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:57 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info" returned: 0 in 0.264s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:57 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info is being set with open permissions: ugo+rw Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:57 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info Aug 04 12:38:57 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:57 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.info" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-77c554b1-3444-4725-aa11-6662b37d425d tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (bc6708e3-a52a-41e2-9c59-9116f4a0ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47100858-7da2-4fa4-b009-a47640cfeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47100858-7da2-4fa4-b009-a47640cfeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083082327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0bf632-d889-4b45-a4a6-fba4bea8c0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:58Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a23694-bb57-409a-b991-db4c4a11840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a23694-bb57-409a-b991-db4c4a11840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8317554-b29b-4b3e-a7ab-2bb62f7e6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8317554-b29b-4b3e-a7ab-2bb62f7e6484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0bf632-d889-4b45-a4a6-fba4bea8c0fc', 'volume_name': 'volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a4f870-6169-44fb-a9df-ddb2aba70bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a4f870-6169-44fb-a9df-ddb2aba70bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2075e5-8e86-4da1-94f2-1c6483501ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Volume 6d0bf632-d889-4b45-a4a6-fba4bea8c0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc', 'volume_size': 1} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083082327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0bf632-d889-4b45-a4a6-fba4bea8c0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:38:58Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Creating volume 6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:38:57 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:57 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc 1073741824 Aug 04 12:38:57 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-5c662694-16ea-4b0a-b330-3320ca4ab5c4-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-5c662694-16ea-4b0a-b330-3320ca4ab5c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-5c662694-16ea-4b0a-b330-3320ca4ab5c4" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-5c662694-16ea-4b0a-b330-3320ca4ab5c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot 5c662694-16ea-4b0a-b330-3320ca4ab5c4 of volume ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38aa7a0-5090-4da1-b96d-4c003df6d4a2]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:57 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 Aug 04 12:38:57 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:58 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc 1073741824" returned: 0 in 0.410s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:58 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc Aug 04 12:38:58 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:58 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4" returned: 0 in 0.358s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac6794e8-f9d3-4c79-a743-263de921a589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276c739-8434-4363-b439-4abf5d3450b3]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:58 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 Aug 04 12:38:58 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:58 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2075e5-8e86-4da1-94f2-1c6483501ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0516cd60-902f-448d-abec-da88302926b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:38:58 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Volume volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc (6d0bf632-d889-4b45-a4a6-fba4bea8c0fc): created successfully Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0516cd60-902f-448d-abec-da88302926b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (bc6708e3-a52a-41e2-9c59-9116f4a0ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:38:58 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-fd35a951-404d-45f2-b701-9ac38d936f5c tempest-ProjectReaderTests-1153750780 None] Created volume successfully. Aug 04 12:38:58 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589" returned: 0 in 0.366s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:58 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 Aug 04 12:38:58 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Creating offline snapshot 7f1b155f-a46d-4ef7-a3e6-95e1982f341c of volume 6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a3f15-0e46-456b-a421-000bf31c96bd]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:58 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc Aug 04 12:38:58 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:58 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4" returned: 0 in 0.350s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:59 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4 Aug 04 12:38:59 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:59 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" returned: 0 in 0.344s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:59 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589.5c662694-16ea-4b0a-b330-3320ca4ab5c4" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:59 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c 1G Aug 04 12:38:59 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-5c662694-16ea-4b0a-b330-3320ca4ab5c4" released by "_delete_snapshot" :: held 1.418s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" released by "delete_snapshot" :: held 1.439s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Created reservations ['ca650596-d948-48fc-b50d-16925e006858', '4a444194-d490-45d8-bdfd-383b0c570712', 'b53b259b-1fea-4422-94aa-8eb7b0f13a8d', '9910f6d0-ff77-4408-a98c-1bc35e4ca39f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:38:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-1dc243ab-b8c5-4c7c-b148-f6def97038fd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-5c662694-16ea-4b0a-b330-3320ca4ab5c4-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:38:59 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c 1G" returned: 0 in 0.368s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:59 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c Aug 04 12:38:59 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:59 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c" returned: 0 in 0.280s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:38:59 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c is being set with open permissions: ugo+rw Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:38:59 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c Aug 04 12:38:59 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-ac6794e8-f9d3-4c79-a743-263de921a589-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:38:59 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-ac6794e8-f9d3-4c79-a743-263de921a589-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd7e090-01ed-4e11-ac20-bb0e4b0a4d39]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:00 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c" returned: 0 in 0.265s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:00 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 Aug 04 12:39:00 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:00 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info Aug 04 12:39:00 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:00 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info" returned: 0 in 0.265s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:00 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info is being set with open permissions: ugo+rw Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:00 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589" returned: 0 in 0.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:00 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info Aug 04 12:39:00 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:00 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589 Aug 04 12:39:00 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:00 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.info" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:00 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-ac6794e8-f9d3-4c79-a743-263de921a589" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-ac6794e8-f9d3-4c79-a743-263de921a589" released by "delete_volume" :: held 0.685s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:00 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-5399328b-e745-4e78-9e38-7a70fcbd153f tempest-ProjectReaderTests-1153750780 None] Create snapshot completed successfully Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Created reservations ['45a47f6b-858b-4240-bfc0-a09e2266611b', '76f2fedb-2195-4153-9794-544c5b441580', 'e898c1f1-4cfc-4ec9-acab-09e55eb61b20', '4af9947e-8c31-4df9-a823-f0520a83cca8'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:00 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:00 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-7f1b155f-a46d-4ef7-a3e6-95e1982f341c-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-7f1b155f-a46d-4ef7-a3e6-95e1982f341c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-7f1b155f-a46d-4ef7-a3e6-95e1982f341c" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-7f1b155f-a46d-4ef7-a3e6-95e1982f341c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Deleting offline snapshot 7f1b155f-a46d-4ef7-a3e6-95e1982f341c of volume 6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] snapshot_file for this snap is: volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:01 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[213de812-9a1a-4268-a02f-b1f88acab543]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:01 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-9c2e695b-7681-42c0-84a7-92c84220ecfd tempest-ProjectMemberTests-1882375512 None] Lock "cinder-ac6794e8-f9d3-4c79-a743-263de921a589-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:01 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c Aug 04 12:39:01 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:01 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c" returned: 0 in 0.391s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab38e0-1c33-4499-ac09-1d755791bf80]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:01 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc Aug 04 12:39:01 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (e523d23a-a9ea-4e29-9a7f-9012cf5dade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bebfecb-20f4-46e0-a51f-2de676aacc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bebfecb-20f4-46e0-a51f-2de676aacc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095483347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b58e9a-596b-4abc-8199-bfc8885b423e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:02Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317e2dab-ff95-4963-8c85-4ca0066df667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317e2dab-ff95-4963-8c85-4ca0066df667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c18a46-6ee4-4e07-99fd-1e5717dfab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c18a46-6ee4-4e07-99fd-1e5717dfab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b58e9a-596b-4abc-8199-bfc8885b423e', 'volume_name': 'volume-79b58e9a-596b-4abc-8199-bfc8885b423e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5121c5-33b7-4de3-af3e-0a5ef30ef529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5121c5-33b7-4de3-af3e-0a5ef30ef529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33945cda-22b5-4faf-b41d-405d1a5515fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:01 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Volume 79b58e9a-596b-4abc-8199-bfc8885b423e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b58e9a-596b-4abc-8199-bfc8885b423e', 'volume_size': 1} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095483347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b58e9a-596b-4abc-8199-bfc8885b423e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:02Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Creating volume 79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:01 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:01 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e 1073741824 Aug 04 12:39:01 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:01 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:01 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:01 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c Aug 04 12:39:01 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:02 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e 1073741824" returned: 0 in 0.412s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:02 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e Aug 04 12:39:02 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:02 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c" returned: 0 in 0.366s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:02 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c Aug 04 12:39:02 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:02 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33945cda-22b5-4faf-b41d-405d1a5515fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b58e9a-596b-4abc-8199-bfc8885b423e', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee96add4-00d7-40d4-a4f6-1440e3aab377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:02 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Volume volume-79b58e9a-596b-4abc-8199-bfc8885b423e (79b58e9a-596b-4abc-8199-bfc8885b423e): created successfully Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee96add4-00d7-40d4-a4f6-1440e3aab377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (e523d23a-a9ea-4e29-9a7f-9012cf5dade9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-9693490f-b701-4d1b-b688-d7858c26d188 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:39:02 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc.7f1b155f-a46d-4ef7-a3e6-95e1982f341c" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-7f1b155f-a46d-4ef7-a3e6-95e1982f341c" released by "_delete_snapshot" :: held 1.474s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" released by "delete_snapshot" :: held 1.499s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Created reservations ['1adf0277-3c19-448c-83e0-49ab0a438ee3', '6b79cf71-e203-46da-9c4b-3263546856ef', '60783170-a01c-4fb9-b55c-35fb2e5e899b', '81840d86-bdc9-4be4-8d40-2a557ad64dac'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:02 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Delete snapshot completed successfully. Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-eba0b2ff-d2ac-4e36-88bb-914c7c957ce2 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-7f1b155f-a46d-4ef7-a3e6-95e1982f341c-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot 4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 of volume 79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0705cc5-cba5-4584-96e7-bd8e93e4afb8]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:02 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:02 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e Aug 04 12:39:02 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:03 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:03 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 1G Aug 04 12:39:03 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff7bc3-0916-4427-b4ef-ec57b59bf295]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:03 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc Aug 04 12:39:03 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 1G" returned: 0 in 0.405s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b58e9a-596b-4abc-8199-bfc8885b423e -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:03 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b58e9a-596b-4abc-8199-bfc8885b423e -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 Aug 04 12:39:03 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" returned: 0 in 0.372s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:03 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc Aug 04 12:39:03 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b58e9a-596b-4abc-8199-bfc8885b423e -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" returned: 0 in 0.303s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:03 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 is being set with open permissions: ugo+rw Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:03 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" returned: 0 in 0.251s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:03 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 Aug 04 12:39:03 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc" released by "delete_volume" :: held 0.682s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:03 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Created reservations ['c50d676d-6620-4c9f-a868-be650ed11266', 'd6fdf238-d87f-4c4c-ae14-9ec1af09766d', 'ab34d1d9-2ff8-4349-808d-cfcfd551bdeb', '6d06b76e-1b2d-41c7-a5cc-09bacf4c8f3f'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:04 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:04 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:04 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:04 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info Aug 04 12:39:04 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:04 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.254s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Deleted volume successfully. Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-16f32708-18c6-4d47-8180-2116bf763227 tempest-ProjectReaderTests-1153750780 None] Lock "cinder-6d0bf632-d889-4b45-a4a6-fba4bea8c0fc-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:04 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info" returned: 0 in 0.259s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:04 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info is being set with open permissions: ugo+rw Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:04 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info Aug 04 12:39:04 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:04 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.info" returned: 0 in 0.273s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:04 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-1138ce11-a861-415d-b05c-5b99ca1a5ee2 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (c842450d-8575-4a9c-83e9-2010309399de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3304c814-4fd2-4601-9587-1ba0e18f8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3304c814-4fd2-4601-9587-1ba0e18f8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876549478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff22738-f6bb-4e91-b1a0-fa28d0c90dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:05Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab9fd0e-5b74-46e0-a5c4-70f32b85c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab9fd0e-5b74-46e0-a5c4-70f32b85c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f52b77-b537-44c6-a7f1-8635f219cc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f52b77-b537-44c6-a7f1-8635f219cc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff22738-f6bb-4e91-b1a0-fa28d0c90dbe', 'volume_name': 'volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71db73fb-6143-420a-9849-6f82ee812aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71db73fb-6143-420a-9849-6f82ee812aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1790cd-4ac8-474a-a262-bbc1d9c38ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:04 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Volume cff22738-f6bb-4e91-b1a0-fa28d0c90dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe', 'volume_size': 1} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876549478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff22738-f6bb-4e91-b1a0-fa28d0c90dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d74e32ed71140249881c1a5be22a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:05Z,use_quota=True,user_id='fa2850aa98b74d1d943cc38d2098bb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Creating volume cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:04 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:04 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe 1073741824 Aug 04 12:39:04 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot 4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 of volume 79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc599ed-27f7-4f43-9ef7-0936fe97e2b9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:05 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 Aug 04 12:39:05 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:05 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe 1073741824" returned: 0 in 0.421s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:05 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe Aug 04 12:39:05 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:05 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" returned: 0 in 0.360s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b58e9a-596b-4abc-8199-bfc8885b423e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c3e6b-ba33-4916-a375-ebd959baaf85]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:05 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e Aug 04 12:39:05 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:05 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" returned: 0 in 0.256s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1790cd-4ac8-474a-a262-bbc1d9c38ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a35a6-ecd1-49a1-b41c-8152968be141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Volume volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe (cff22738-f6bb-4e91-b1a0-fa28d0c90dbe): created successfully Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a35a6-ecd1-49a1-b41c-8152968be141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Flow 'volume_create_manager' (c842450d-8575-4a9c-83e9-2010309399de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-7752bef8-df76-48a6-b578-8ed5b574a65c tempest-ProjectReaderTests-1153750780 None] Created volume successfully. Aug 04 12:39:05 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e" returned: 0 in 0.373s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:05 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 Aug 04 12:39:05 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Creating offline snapshot 5e192cff-dd16-417f-8785-df859700684e of volume cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f7f6e-6bb4-4ef7-8923-dcd4a679c028]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:06 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" returned: 0 in 0.334s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:06 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe Aug 04 12:39:06 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:06 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14 Aug 04 12:39:06 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:06 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:06 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:06 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e.4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" returned: 0 in 0.249s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:06 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" returned: 0 in 0.386s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14" released by "_delete_snapshot" :: held 1.431s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" released by "delete_snapshot" :: held 1.456s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:06 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e 1G Aug 04 12:39:06 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Created reservations ['c056538d-d43f-4092-bd24-7f515b624934', '45ba5380-665b-41f7-af37-6df1bf901648', 'eb85a0ae-357c-4781-bcad-1b50e4c974ca', '42433b4c-9db2-4213-ba9b-d42de63d051d'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:06 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-65d99f7f-b9c7-4cc4-8659-320839c5e671 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-4a1c3c8d-9cb3-4dd3-8fe4-fa6915b1fc14-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:06 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.263s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:39:06 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e 1G" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:06 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e Aug 04 12:39:06 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-79b58e9a-596b-4abc-8199-bfc8885b423e-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:07 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e" returned: 0 in 0.294s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e is being set with open permissions: ugo+rw Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-79b58e9a-596b-4abc-8199-bfc8885b423e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:07 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e Aug 04 12:39:07 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5326366-f03b-4573-87e6-42c464485c74]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e Aug 04 12:39:07 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info Aug 04 12:39:07 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e" returned: 0 in 0.357s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e Aug 04 12:39:07 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info" returned: 0 in 0.261s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info is being set with open permissions: ugo+rw Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info Aug 04 12:39:07 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:07 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-79b58e9a-596b-4abc-8199-bfc8885b423e" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-79b58e9a-596b-4abc-8199-bfc8885b423e" released by "delete_volume" :: held 0.645s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Created reservations ['538f769e-e9ac-4ad9-9f1a-84062aa6e87e', 'b53ba53e-5975-4c61-a90e-a43e055186f9', '3bd5be60-8e6c-4018-913b-e57ea1c8863f', '7cc25cb5-f04e-40a4-a837-15971ca33460'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:07 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.info" returned: 0 in 0.246s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0df4a119-dfad-4ff6-b612-4a83f1acdefe tempest-ProjectReaderTests-1153750780 None] Create snapshot completed successfully Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:07 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:07 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-5e192cff-dd16-417f-8785-df859700684e-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-5e192cff-dd16-417f-8785-df859700684e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-5e192cff-dd16-417f-8785-df859700684e" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-5e192cff-dd16-417f-8785-df859700684e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Deleting offline snapshot 5e192cff-dd16-417f-8785-df859700684e of volume cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] snapshot_file for this snap is: volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d97a927-c292-47a0-ae28-402c909d2b15]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:08 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-01b53af4-d06d-47a8-ae7f-e38af6d9a1a6 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-79b58e9a-596b-4abc-8199-bfc8885b423e-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:08 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e Aug 04 12:39:08 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:08 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e" returned: 0 in 0.383s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7bc9d0-87df-4f1f-9599-41fa55d09d19]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:08 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe Aug 04 12:39:08 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (660d05d2-7108-4340-a0e0-bf460fc43da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a98479-5953-4c69-b70e-10391adf30d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a98479-5953-4c69-b70e-10391adf30d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851784373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0698a6-105f-4198-876d-5a8b405c2e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:09Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9885b-c11d-4046-b0e8-a2b39b93df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9885b-c11d-4046-b0e8-a2b39b93df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd00e7-3b8f-4315-813e-2e0ff6872720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd00e7-3b8f-4315-813e-2e0ff6872720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0698a6-105f-4198-876d-5a8b405c2e26', 'volume_name': 'volume-8b0698a6-105f-4198-876d-5a8b405c2e26', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5dd35f-c688-4de5-9835-1f5b7804a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5dd35f-c688-4de5-9835-1f5b7804a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83575f2-09fd-4d57-84e5-85e1d84c9757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:08 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Volume 8b0698a6-105f-4198-876d-5a8b405c2e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0698a6-105f-4198-876d-5a8b405c2e26', 'volume_size': 1} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851784373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0698a6-105f-4198-876d-5a8b405c2e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:09Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Creating volume 8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:08 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:08 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 1073741824 Aug 04 12:39:08 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:08 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" returned: 0 in 0.378s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:08 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e Aug 04 12:39:08 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:09 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 1073741824" returned: 0 in 0.408s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:09 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 Aug 04 12:39:09 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:09 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:09 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e Aug 04 12:39:09 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:09 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83575f2-09fd-4d57-84e5-85e1d84c9757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0698a6-105f-4198-876d-5a8b405c2e26', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb5c54a-b6fc-430b-b9d4-10f948496e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:09 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Volume volume-8b0698a6-105f-4198-876d-5a8b405c2e26 (8b0698a6-105f-4198-876d-5a8b405c2e26): created successfully Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb5c54a-b6fc-430b-b9d4-10f948496e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (660d05d2-7108-4340-a0e0-bf460fc43da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cbbbf2b1-985f-4166-8341-93c0ae0e7d33 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:39:09 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe.5e192cff-dd16-417f-8785-df859700684e" returned: 0 in 0.284s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-5e192cff-dd16-417f-8785-df859700684e" released by "_delete_snapshot" :: held 1.516s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" released by "delete_snapshot" :: held 1.539s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Created reservations ['94c62bca-b3c1-4110-80d6-44f96f9d6457', '8b437d2c-1321-4fb6-ad8d-4936fb91afe9', '697f1e45-aaed-40a0-b6a5-4010f611934d', '2f05d0dc-5267-4e95-bf78-4c1ffdaba4ea'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Delete snapshot completed successfully. Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-a513d118-cfe2-46e7-bb1d-0e364e860a5b tempest-ProjectReaderTests-1153750780 None] Lock "cinder-5e192cff-dd16-417f-8785-df859700684e-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot 026a2e8f-4b9a-4d89-975a-f589fdced926 of volume 8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c56e5a-3c71-41f3-9611-2f4e0e19a467]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:09 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 Aug 04 12:39:09 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "cinder-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:10 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26" returned: 0 in 0.354s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:10 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 1G Aug 04 12:39:10 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Acquiring lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7ac5b-8f96-4c10-9d34-a71380b17932]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:10 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe Aug 04 12:39:10 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 1G" returned: 0 in 0.379s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0698a6-105f-4198-876d-5a8b405c2e26 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:10 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0698a6-105f-4198-876d-5a8b405c2e26 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 Aug 04 12:39:10 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" returned: 0 in 0.364s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:10 devstack sudo[109639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe Aug 04 12:39:10 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0698a6-105f-4198-876d-5a8b405c2e26 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926" returned: 0 in 0.304s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:10 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 is being set with open permissions: ugo+rw Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:10 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" returned: 0 in 0.245s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:10 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 Aug 04 12:39:10 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:10 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "cinder-quobyte-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe" released by "delete_volume" :: held 0.669s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Created reservations ['61814c3b-bc60-4a2d-9193-c39d6963d6f6', '4e503a1e-1744-4a66-bea9-36173ed85daf', '48005d0e-511e-435e-993d-9e762192a2c8', 'ba93c5ac-64df-4fea-b6ec-406e532fe583'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:11 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:11 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:11 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:11 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info Aug 04 12:39:11 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:11 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Deleted volume successfully. Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c8ee0739-37b9-44d8-bd6e-be7840a4ffbe tempest-ProjectReaderTests-1153750780 None] Lock "cinder-cff22738-f6bb-4e91-b1a0-fa28d0c90dbe-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:11 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info" returned: 0 in 0.259s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:11 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info is being set with open permissions: ugo+rw Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:11 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info Aug 04 12:39:11 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:11 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.info" returned: 0 in 0.235s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:11 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-843fbda8-a85e-4b5e-a49c-d15ca6a573c2 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:39:11 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-026a2e8f-4b9a-4d89-975a-f589fdced926-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-026a2e8f-4b9a-4d89-975a-f589fdced926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-026a2e8f-4b9a-4d89-975a-f589fdced926" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-026a2e8f-4b9a-4d89-975a-f589fdced926" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot 026a2e8f-4b9a-4d89-975a-f589fdced926 of volume 8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[21115bb0-50e4-4b78-9ff8-de55c34d532a]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:12 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 Aug 04 12:39:12 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:12 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926" returned: 0 in 0.367s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b0698a6-105f-4198-876d-5a8b405c2e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff5d34d-5abb-474d-8481-4de68b07f750]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:12 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 Aug 04 12:39:12 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:12 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26" returned: 0 in 0.407s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:12 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:12 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 Aug 04 12:39:12 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:13 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:13 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926 Aug 04 12:39:13 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:13 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26.026a2e8f-4b9a-4d89-975a-f589fdced926" returned: 0 in 0.242s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-026a2e8f-4b9a-4d89-975a-f589fdced926" released by "_delete_snapshot" :: held 1.438s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" released by "delete_snapshot" :: held 1.465s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Created reservations ['082a1dca-8efa-45de-8754-65e69c08ad10', 'f46ac727-0113-4979-839d-f1616638cf16', '5eb31e6c-ca6c-4950-b0c1-33bf2c275c79', 'c32eeb2f-2627-44b2-9013-c48e930544f9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:13 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:39:13 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-61abbf2d-8c1c-4f22-a2ad-79142ca9c346 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-026a2e8f-4b9a-4d89-975a-f589fdced926-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-8b0698a6-105f-4198-876d-5a8b405c2e26-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-8b0698a6-105f-4198-876d-5a8b405c2e26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[38116625-b97b-42f0-88cf-6a8d6a1dd220]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:14 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 Aug 04 12:39:14 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:14 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26" returned: 0 in 0.350s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:14 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26 Aug 04 12:39:14 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:14 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-8b0698a6-105f-4198-876d-5a8b405c2e26" returned: 0 in 0.237s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-8b0698a6-105f-4198-876d-5a8b405c2e26" released by "delete_volume" :: held 0.638s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Created reservations ['cb312fe9-c0df-4d5c-88dc-a525d6b0d855', '8f1cd7ac-89ea-419c-8b57-040361e4b691', 'e278a392-9b99-487e-978d-365472d18b3a', 'd2308991-2e5d-42d0-b099-641fcfc5ff35'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:14 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:14 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:14 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:15 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:15 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-3e81fd03-5e62-4287-8a58-4747f934ba4a tempest-ProjectMemberTests-1882375512 None] Lock "cinder-8b0698a6-105f-4198-876d-5a8b405c2e26-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (23215151-d88b-44c8-b1bc-cef93f65e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdc138e-8e32-4fe1-b095-3cf3081bf385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdc138e-8e32-4fe1-b095-3cf3081bf385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918634013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3feae5-6831-403c-905c-880695556a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:16Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015b9d44-50e9-4620-862b-cfb3b30950cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015b9d44-50e9-4620-862b-cfb3b30950cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293aaa57-8ace-423b-8106-9d9ff2a29fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293aaa57-8ace-423b-8106-9d9ff2a29fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3feae5-6831-403c-905c-880695556a95', 'volume_name': 'volume-7e3feae5-6831-403c-905c-880695556a95', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58129784-8eeb-4a44-a756-0b8a6a83ada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58129784-8eeb-4a44-a756-0b8a6a83ada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579ddb6e-0920-41b7-9e88-de988b240a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:15 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Volume 7e3feae5-6831-403c-905c-880695556a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3feae5-6831-403c-905c-880695556a95', 'volume_size': 1} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918634013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3feae5-6831-403c-905c-880695556a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:16Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Creating volume 7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:15 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:15 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:15 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 1073741824 Aug 04 12:39:15 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:16 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 1073741824" returned: 0 in 0.392s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=286,cinder:SELECT=228,cinder:INSERT=79,cinder:DELETE=19 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=219,cinder:INSERT=84,cinder:UPDATE=302,cinder:DELETE=31 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:16 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 Aug 04 12:39:16 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:16 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95" returned: 0 in 0.235s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579ddb6e-0920-41b7-9e88-de988b240a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3feae5-6831-403c-905c-880695556a95', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103734f7-57d9-4455-9d5a-d66588783c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:16 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Volume volume-7e3feae5-6831-403c-905c-880695556a95 (7e3feae5-6831-403c-905c-880695556a95): created successfully Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103734f7-57d9-4455-9d5a-d66588783c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (23215151-d88b-44c8-b1bc-cef93f65e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:16 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-a7c9edf5-221e-4144-ba99-a2be013b4cc3 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot 7142f479-b613-4875-baf6-691e0e41610c of volume 7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaecf8a-0dd8-4657-9676-063589165e81]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:16 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:16 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 Aug 04 12:39:17 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:17 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95" returned: 0 in 0.351s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:17 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c 1G Aug 04 12:39:17 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:17 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c 1G" returned: 0 in 0.385s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3feae5-6831-403c-905c-880695556a95 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:17 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3feae5-6831-403c-905c-880695556a95 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c Aug 04 12:39:17 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:17 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3feae5-6831-403c-905c-880695556a95 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c" returned: 0 in 0.297s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:17 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c is being set with open permissions: ugo+rw Aug 04 12:39:17 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:17 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c Aug 04 12:39:17 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:18 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c" returned: 0 in 0.232s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:18 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info Aug 04 12:39:18 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:18 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:18 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info is being set with open permissions: ugo+rw Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:18 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info Aug 04 12:39:18 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:18 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.info" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:18 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cc0acea1-0573-4f72-9f49-23b9e24b7a01 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:39:18 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-7142f479-b613-4875-baf6-691e0e41610c-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7142f479-b613-4875-baf6-691e0e41610c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-7142f479-b613-4875-baf6-691e0e41610c" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7142f479-b613-4875-baf6-691e0e41610c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot 7142f479-b613-4875-baf6-691e0e41610c of volume 7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2eef95-cea6-445c-94e0-790e53a16c43]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:19 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c Aug 04 12:39:19 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:19 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c" returned: 0 in 0.359s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3feae5-6831-403c-905c-880695556a95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[923c8619-e6e7-4648-9e61-8f7968cb78a6]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:19 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 Aug 04 12:39:19 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:19 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95" returned: 0 in 0.342s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:19 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:19 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c Aug 04 12:39:19 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:20 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c" returned: 0 in 0.331s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:20 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c Aug 04 12:39:20 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:20 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95.7142f479-b613-4875-baf6-691e0e41610c" returned: 0 in 0.238s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7142f479-b613-4875-baf6-691e0e41610c" released by "_delete_snapshot" :: held 1.358s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" released by "delete_snapshot" :: held 1.379s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Created reservations ['2cf959f2-3df3-410f-96ef-ae8251e9020a', '77098709-b984-4444-99d6-d6699d4195f9', '93e2d85b-edc0-4872-bf04-535a7c09a3fd', '48a48e06-fab3-44c9-8282-e5b30013bacb'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:20 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:39:20 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-c1a8378b-09b9-4c60-8913-1bcf4c73f091 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7142f479-b613-4875-baf6-691e0e41610c-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-7e3feae5-6831-403c-905c-880695556a95-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7e3feae5-6831-403c-905c-880695556a95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" acquired by "delete_volume" :: waited 0.014s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b467d-e82c-4074-a653-a34160817608]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:21 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 Aug 04 12:39:21 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:21 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:21 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95 Aug 04 12:39:21 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:21 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7e3feae5-6831-403c-905c-880695556a95" returned: 0 in 0.230s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-7e3feae5-6831-403c-905c-880695556a95" released by "delete_volume" :: held 0.620s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Created reservations ['32701a4b-5279-47d6-b4f9-f6417349f286', '0c008a8c-1f51-4d16-90cb-3d16ba192196', '0157d0de-56f4-4a64-a8e2-d2ec13c112f3', '0dd64986-8786-4355-b473-d970fa51e700'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:21 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:21 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:21 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:22 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.231s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:22 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-6db1e81a-268a-48b5-b20c-cd784716fc1e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-7e3feae5-6831-403c-905c-880695556a95-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (f7302f9b-3d47-40b4-a47e-ad4f5b19281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb84e85-ac65-4a5c-89a2-73c9aab5190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb84e85-ac65-4a5c-89a2-73c9aab5190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1108725085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe16258-3e56-4320-945b-27a70b7c53a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:23Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5c5b9e-16f9-4063-9735-6975666df23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5c5b9e-16f9-4063-9735-6975666df23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc08466-13f3-4db7-982f-66ea1c45c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc08466-13f3-4db7-982f-66ea1c45c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe16258-3e56-4320-945b-27a70b7c53a9', 'volume_name': 'volume-cfe16258-3e56-4320-945b-27a70b7c53a9', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdb81de-7a51-4bda-8313-e841cbd88b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdb81de-7a51-4bda-8313-e841cbd88b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be725a8b-5ff0-4496-870d-6c3c4996f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:22 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Volume cfe16258-3e56-4320-945b-27a70b7c53a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe16258-3e56-4320-945b-27a70b7c53a9', 'volume_size': 1} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1108725085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe16258-3e56-4320-945b-27a70b7c53a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f76a885d47c46c6881bbeaf50ab439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:23Z,use_quota=True,user_id='a35a46db8e52465c9e4e2a2043c20332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Creating volume cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:22 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:22 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:22 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 1073741824 Aug 04 12:39:22 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:23 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 1073741824" returned: 0 in 0.389s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:23 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 Aug 04 12:39:23 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:23 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9" returned: 0 in 0.232s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be725a8b-5ff0-4496-870d-6c3c4996f529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe16258-3e56-4320-945b-27a70b7c53a9', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa8bb51-5c04-486c-b0a7-aebae249ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:23 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Volume volume-cfe16258-3e56-4320-945b-27a70b7c53a9 (cfe16258-3e56-4320-945b-27a70b7c53a9): created successfully Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa8bb51-5c04-486c-b0a7-aebae249ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Flow 'volume_create_manager' (f7302f9b-3d47-40b4-a47e-ad4f5b19281f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:23 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b510bf21-306d-4820-bacf-11c47a8bf078 tempest-ProjectMemberTests-1882375512 None] Created volume successfully. Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Creating offline snapshot a266c558-f4e7-463b-bdda-7cd133155326 of volume cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af51c7-2cd6-4013-aa45-0a875e817825]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:23 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:23 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 Aug 04 12:39:23 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:24 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9" returned: 0 in 0.330s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:24 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 1G Aug 04 12:39:24 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:24 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 1G" returned: 0 in 0.361s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe16258-3e56-4320-945b-27a70b7c53a9 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:24 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe16258-3e56-4320-945b-27a70b7c53a9 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 Aug 04 12:39:24 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:24 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe16258-3e56-4320-945b-27a70b7c53a9 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326" returned: 0 in 0.266s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:24 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 is being set with open permissions: ugo+rw Aug 04 12:39:24 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:24 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 Aug 04 12:39:24 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:25 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:25 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info Aug 04 12:39:25 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:25 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info" returned: 0 in 0.250s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:25 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info is being set with open permissions: ugo+rw Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:25 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info Aug 04 12:39:25 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:25 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.info" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:25 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.749s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:25 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-b97f41d3-a0bd-467c-ba83-4359bc7bd0f5 tempest-ProjectMemberTests-1882375512 None] Create snapshot completed successfully Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-a266c558-f4e7-463b-bdda-7cd133155326-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a266c558-f4e7-463b-bdda-7cd133155326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-a266c558-f4e7-463b-bdda-7cd133155326" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a266c558-f4e7-463b-bdda-7cd133155326" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Deleting offline snapshot a266c558-f4e7-463b-bdda-7cd133155326 of volume cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] snapshot_file for this snap is: volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9033c4-9cf6-4dd9-865b-3907ca341017]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:26 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 Aug 04 12:39:26 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:26 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326" returned: 0 in 0.335s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe16258-3e56-4320-945b-27a70b7c53a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa61cc6-a57b-4025-b5fe-229484faf1e9]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:26 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 Aug 04 12:39:26 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:26 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9" returned: 0 in 0.356s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:26 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:26 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 Aug 04 12:39:26 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:27 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:27 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326 Aug 04 12:39:27 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:27 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9.a266c558-f4e7-463b-bdda-7cd133155326" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-a266c558-f4e7-463b-bdda-7cd133155326" released by "_delete_snapshot" :: held 1.365s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" released by "delete_snapshot" :: held 1.384s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Created reservations ['64521c77-925d-4543-a87b-404220529936', '4470155e-fdc6-433d-a23b-bfe23d4dde6d', '8447be94-605b-4516-8b02-f0a8947897d2', '4fdf8b80-d996-434f-8ca3-672e89e890f9'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:27 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Delete snapshot completed successfully. Aug 04 12:39:27 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-dd26e239-a593-4577-9faa-1d72bf80336e tempest-ProjectMemberTests-1882375512 None] Lock "cinder-a266c558-f4e7-463b-bdda-7cd133155326-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-cfe16258-3e56-4320-945b-27a70b7c53a9-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-cfe16258-3e56-4320-945b-27a70b7c53a9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201d839-eb52-47c1-8422-e0c8c96e2bab]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:28 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 Aug 04 12:39:28 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:28 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:28 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9 Aug 04 12:39:28 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:28 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-cfe16258-3e56-4320-945b-27a70b7c53a9" returned: 0 in 0.243s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-quobyte-cfe16258-3e56-4320-945b-27a70b7c53a9" released by "delete_volume" :: held 0.628s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:28 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Created reservations ['5381755e-bda8-4679-8406-4882499c5f57', 'a09c9c6c-e037-4283-bd6b-045d4bda26fa', 'b575209d-fb0e-4569-ad30-0cdb4d043ef1', 'e44ed61e-ecff-4ba0-b9da-878498290595'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:29 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:39:29 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:29 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.241s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:39:29 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Deleted volume successfully. Aug 04 12:39:29 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-0e5e2188-9217-41e6-87bf-3e73cf267f67 tempest-ProjectMemberTests-1882375512 None] Lock "cinder-cfe16258-3e56-4320-945b-27a70b7c53a9-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:39:39 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=5 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:39:39 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=33,cinder:SELECT=29,cinder:INSERT=10,cinder:DELETE=1 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Flow 'volume_create_manager' (f93421e8-5cef-4ce3-bc42-32a485ebd1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd224059-9bb3-45da-8db5-045e88565073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd224059-9bb3-45da-8db5-045e88565073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-908630177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fee2b38-56be-4b2f-b561-52576c15f949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2672a598a47244589b7e497a129e2cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:56Z,use_quota=True,user_id='b89f2e84dc8c44ceb4f8e6a1597a5d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70102e2e-f9dc-49b5-a9bc-525be973b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70102e2e-f9dc-49b5-a9bc-525be973b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51a57f7-457c-4b2c-b0c3-0b35eda02b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51a57f7-457c-4b2c-b0c3-0b35eda02b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fee2b38-56be-4b2f-b561-52576c15f949', 'volume_name': 'volume-7fee2b38-56be-4b2f-b561-52576c15f949', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb5d36e-5676-4020-a803-a117f6236037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb5d36e-5676-4020-a803-a117f6236037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecaf45d-f0e5-4d4c-916a-10b02534a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:56 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Volume 7fee2b38-56be-4b2f-b561-52576c15f949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fee2b38-56be-4b2f-b561-52576c15f949', 'volume_size': 1} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-908630177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fee2b38-56be-4b2f-b561-52576c15f949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2672a598a47244589b7e497a129e2cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:39:56Z,use_quota=True,user_id='b89f2e84dc8c44ceb4f8e6a1597a5d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)}" {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Creating volume 7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:39:56 devstack cinder-volume[88895]: INFO cinder.volume.drivers.remotefs [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] casted to osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 1073741824 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:56 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 1073741824 Aug 04 12:39:56 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:56 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 1073741824" returned: 0 in 0.408s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:56 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:39:56 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:56 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.253s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'} {{(pid=88895) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecaf45d-f0e5-4d4c-916a-10b02534a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fee2b38-56be-4b2f-b561-52576c15f949', 'volume_size': 1}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:56 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cbe371-5633-4fd2-9974-faafbf2266a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:39:57 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Volume volume-7fee2b38-56be-4b2f-b561-52576c15f949 (7fee2b38-56be-4b2f-b561-52576c15f949): created successfully Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cbe371-5633-4fd2-9974-faafbf2266a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Flow 'volume_create_manager' (f93421e8-5cef-4ce3-bc42-32a485ebd1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:39:57 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-6a2b33bb-aa09-4122-9526-917f0f7c0781 tempest-SnapshotDependencyTests-700631639 None] Created volume successfully. Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Creating offline snapshot f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 of volume 7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fc34c8-bbbe-460f-afa6-fa202125276b]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:57 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:39:57 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:57 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:57 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 1G {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:57 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 1G Aug 04 12:39:57 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:58 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 1G" returned: 0 in 0.394s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fee2b38-56be-4b2f-b561-52576c15f949 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:58 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fee2b38-56be-4b2f-b561-52576c15f949 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:39:58 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:58 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fee2b38-56be-4b2f-b561-52576c15f949 -F qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.291s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:58 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 is being set with open permissions: ugo+rw Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:58 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:39:58 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:58 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:58 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:58 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info Aug 04 12:39:58 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:59 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info" returned: 0 in 0.255s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:59 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info is being set with open permissions: ugo+rw Aug 04 12:39:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:39:59 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info Aug 04 12:39:59 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:39:59 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Aug 04 12:39:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.info" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:39:59 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:39:59 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-792cf30f-4148-4814-a210-0176a5511256 tempest-SnapshotDependencyTests-700631639 None] Create snapshot completed successfully Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.flows.manager.create_volume [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88895) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Flow 'volume_create_manager' (13aec21c-c5e5-4a83-91b8-44490c201021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89c4257-5974-450c-b5c6-72024de9ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89c4257-5974-450c-b5c6-72024de9ed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-04T10:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2672a598a47244589b7e497a129e2cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T10:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T10:40:00Z,use_quota=True,user_id='b89f2e84dc8c44ceb4f8e6a1597a5d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04cdb56a-1023-4764-b6cd-8d8548260b6e),volume_type_id=04cdb56a-1023-4764-b6cd-8d8548260b6e)' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608361a-c4ca-4fa5-b1dd-b88d5b88f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608361a-c4ca-4fa5-b1dd-b88d5b88f526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d7e56f-3e35-43bf-a76f-064a83e482ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d7e56f-3e35-43bf-a76f-064a83e482ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0', 'volume_name': 'volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0', 'volume_size': 1, 'snapshot_id': 'f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce32d66-3505-4338-93d2-0cb1c053216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce32d66-3505-4338-93d2-0cb1c053216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54baddfc-f88d-4fe1-acdb-e91098b50eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:00 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Volume 41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0', 'volume_size': 1, 'snapshot_id': 'f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4'} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" by "_create_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Creating volume 41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 from snapshot f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Selected osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3 as target Quobyte volume. {{(pid=88895) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" by "_copy_volume_from_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] snapshot: f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4, volume: 41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0, {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[395aede8-b993-466f-9035-55db876adc35]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:00 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:40:00 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:00 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.361s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fee2b38-56be-4b2f-b561-52576c15f949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001ed7e-597d-46e4-96a4-65e98cb6c1f1]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:00 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:40:00 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:00 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.355s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Creating direct copy from snapshot {{(pid=88895) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG cinder.utils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Path /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 not found in is_blk_device check {{(pid=88895) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 04 12:40:00 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:01 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 Aug 04 12:40:01 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:04 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" returned: 0 in 3.933s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:04 devstack cinder-volume[88895]: DEBUG cinder.image.image_utils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Image conversion details: src /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 {{(pid=88895) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 04 12:40:04 devstack cinder-volume[88895]: INFO cinder.image.image_utils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Converted 1024.00 MB image at 260.30 MB/s Aug 04 12:40:04 devstack cinder-volume[88895]: WARNING cinder.volume.drivers.remotefs [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 is being set with open permissions: ugo+rw Aug 04 12:40:04 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:04 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 Aug 04 12:40:04 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:05 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" released by "_copy_volume_from_snapshot" :: held 4.956s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" released by "_create_volume_from_snapshot" :: held 5.017s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.030s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54baddfc-f88d-4fe1-acdb-e91098b50eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0', 'volume_size': 1, 'snapshot_id': 'f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4'}' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf76a16-f387-498e-9bd7-9580a293cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 04 12:40:05 devstack cinder-volume[88895]: INFO cinder.volume.flows.manager.create_volume [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Volume volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 (41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0): created successfully Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf76a16-f387-498e-9bd7-9580a293cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88895) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Flow 'volume_create_manager' (13aec21c-c5e5-4a83-91b8-44490c201021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88895) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 04 12:40:05 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-d462455a-d697-4fa2-9f86-931d6d9cd410 tempest-SnapshotDependencyTests-700631639 None] Created volume successfully. Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-delete_snapshot" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" by "delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" by "_delete_snapshot" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Deleting offline snapshot f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 of volume 7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] snapshot_file for this snap is: volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[597826b1-a841-412e-a68b-25e2fbe3ce12]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:05 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:05 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:40:05 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:06 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.341s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.remotefs [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fee2b38-56be-4b2f-b561-52576c15f949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88895) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bbe47a-5b7b-4aeb-a242-961e73cb33ef]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:06 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:40:06 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:06 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:40:06 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:06 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.248s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_service.periodic_task [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] Running periodic task VolumeManager._thread_info {{(pid=88895) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread count: 29 {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG cinder.volume.manager [None req-a410e5cc-2a41-4da3-877e-88d6c3cf58eb None None] thread info: [<_MainThread(MainThread, started 135914134261888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88895) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 04 12:40:06 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.526s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:06 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:40:06 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:06 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.311s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:06 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:06 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4 Aug 04 12:40:06 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:07 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949.f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" returned: 0 in 0.234s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4" released by "_delete_snapshot" :: held 1.502s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" released by "delete_snapshot" :: held 1.521s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Created reservations ['79d81929-4c7a-4247-8553-e104f5f5c27b', 'f34f6c03-9d20-4626-99f2-b81b629151d7', 'e303218f-a69d-4aca-aa5b-f13770b5c313', '1591e609-6cdd-4e33-8950-84c9b78a4b44'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:40:07 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Delete snapshot completed successfully. Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-cfedc3e9-c0ec-4d9a-a595-9b8f9b129c43 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-f1b63a92-c3ee-4c32-ae4b-11eedb79f4f4-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-7fee2b38-56be-4b2f-b561-52576c15f949-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-7fee2b38-56be-4b2f-b561-52576c15f949-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" acquired by "delete_volume" :: waited 0.015s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da831b-6c9d-48fd-aeee-77f483ff0474]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:07 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:07 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:40:07 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:08 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.337s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:08 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949 Aug 04 12:40:08 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:08 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-7fee2b38-56be-4b2f-b561-52576c15f949" returned: 0 in 0.235s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-7fee2b38-56be-4b2f-b561-52576c15f949" released by "delete_volume" :: held 0.625s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Created reservations ['fe6ba5dc-e3d1-41a9-819f-c1d84843a7d3', '1a4002e2-8a9f-40ab-997e-862791ea7886', '635babc0-1f7e-4c53-8ede-16b88a822e44', '904626e2-cb2c-49dd-99c8-9bd2754a67c3'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:08 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:40:08 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:08 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:40:08 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Deleted volume successfully. Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-e340e81a-a73a-40b3-830b-9794bbf8f800 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-7fee2b38-56be-4b2f-b561-52576c15f949-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0-delete_volume" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" by "delete_volume" {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" acquired by "delete_volume" :: waited 0.017s {{(pid=88895) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17cfd4d-ab68-488a-8d03-af4360931869]: (4, 'qcow2') {{(pid=91703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 04 12:40:08 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:09 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 Aug 04 12:40:09 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:09 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" returned: 0 in 0.347s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:09 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0 Aug 04 12:40:09 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:09 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52/volume-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" returned: 0 in 0.244s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-quobyte-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0" released by "delete_volume" :: held 0.628s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.quota [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Created reservations ['dfde851e-518d-4f6e-8c83-d076a836c84f', 'a302fa5c-6750-4e35-8767-4c5aa2f0fcb2', '62e0deb8-dc0d-44ee-ac75-d4b5a3409e39', 'eecb1546-0436-48bc-aa76-ef7b60f09320'] {{(pid=88895) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3': None} {{(pid=88895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.volume.drivers.quobyte [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3367c70c-da6e-43c4-8676-3d24a80612d3'] {{(pid=88895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.lockutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 04 12:40:09 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52 Aug 04 12:40:09 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 04 12:40:09 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG oslo_concurrency.processutils [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a730372ec775793523a9100d4fb35c52" returned: 0 in 0.239s {{(pid=88895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.manager [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Notifying Schedulers of capabilities ... {{(pid=88895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 04 12:40:09 devstack cinder-volume[88895]: INFO cinder.volume.manager [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Deleted volume successfully. Aug 04 12:40:09 devstack cinder-volume[88895]: DEBUG cinder.coordination [None req-94345259-aa4e-4b94-9ae5-98ced9427341 tempest-SnapshotDependencyTests-700631639 None] Lock "cinder-41e4c2f9-a8bc-4ade-b810-e1859e1fd0e0-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88895) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 04 12:40:21 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=3,cinder:SELECT=21 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 04 12:40:21 devstack cinder-volume[88895]: DEBUG dbcounter [-] [88895] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}